00000001:02000400:0.0F:1790918852.431961:0:2962:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg127-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1790918871.354097:0:3182:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg127-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1790918873.301223:0:3245:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 581 MB/s 00000001:01000000:2.0:1790918873.550940:0:3245:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 595 MB/s 00000001:01000000:1.0F:1790918873.803048:0:3245:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3603 MB/s 00000020:02000000:2.0:1790918874.410745:0:3274:0:(class_obd.c:846:obdclass_init()) Lustre: Build Version: 2.17.59_2_g8e10c0d 00000400:02000000:3.0:1790918875.490995:0:3289:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.201.127@tcp [8/256/0/180] 00008000:02000000:3.0:1790918879.079331:0:3437:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1790918926.774368:0:5248:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg127-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1790918935.733846:0:5825:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1790918935.733852:0:5825:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1790918935.733991:0:5825:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000fb0ab2a5 00000080:02000400:1.0:1790918935.734001:0:5825:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' or install '{/usr}/sbin/mount.lustre_tgt' 00000020:01000004:1.0:1790918935.742741:0:5825:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1790918935.742876:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1790918935.742988:0:5825:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000004493fe02) 00000020:00000080:0.0:1790918935.743007:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1790918935.765351:0:5825:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1790918935.766056:0:5825:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1790918935.794243:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1790918935.794348:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1790918935.794376:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1790918935.794428:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1790918935.794454:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1790918935.795088:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1790918935.795096:0:5825:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790918935.795107:0:5825:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3296956897c3f26 00000020:01000004:2.0:1790918935.795114:0:5825:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1790918935.795119:0:5825:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1790918935.795123:0:5825:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000fb0ab2a5 from MGS 00000020:01000004:2.0:1790918935.795191:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1790918935.795210:0:5825:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000542ab0e5) 00000020:00000080:2.0:1790918935.795222:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1790918935.795343:0:5825:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000fb0ab2a5 from MGS, refs=2 00080000:01000000:2.0:1790918935.795349:0:5825:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790918935.795354:0:5825:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3296956897c3f34 00000100:00100000:2.0:1790918935.795446:0:5825:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1790918935.796045:0:5825:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1790918935.796051:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1790918935.796972:0:5825:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1790918935.796981:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1790918935.798059:0:5825:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790918935.798277:0:5825:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1790918935.798349:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1790918935.799411:0:5825:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1790918935.799419:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1790918935.800007:0:5825:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1790918935.800014:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1790918935.805888:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790918935.805894:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790918935.805896:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790918935.806564:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790918935.806567:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790918935.806569:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790918935.807485:0:5825:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1790918935.810863:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1790918936.056778:0:5825:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2399 MB/s 00000001:01000000:3.0:1790918936.306639:0:5825:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2687 MB/s 00000001:01000000:1.0:1790918936.566802:0:5825:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 342 MB/s 00000001:01000000:2.0:1790918936.817011:0:5825:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 567 MB/s 00080000:10000000:3.0:1790918936.830576:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:1.0:1790918936.832595:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1790918936.860317:0:5825:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1790918936.860334:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1790918936.860337:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1790918936.864844:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1790918936.864949:0:5825:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1790918936.865012:0:5825:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1790918936.865264:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1790918936.865291:0:5825:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1790918936.865893:0:5825:0:(service.c:173:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790918936.866052:0:5825:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1790918936.866065:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1790918936.867579:0:5825:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1790918936.867589:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1790918936.876761:0:5825:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1790918936.876775:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1790918936.880440:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1790918936.880469:0:5825:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.127@tcp' 00000020:01000004:3.0:1790918936.880470:0:5825:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1790918936.880562:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.127@tcp (typ=mgc) 00000020:00000080:3.0:1790918936.880586:0:5825:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.127@tcp (00000000bbbf5ff4) 00000020:00000080:3.0:1790918936.880603:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1790918936.880848:0:5825:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000d96b77eb@MGC192.168.201.127@tcp: add connection 192.168.201.127@tcp at head 00010000:00010000:3.0:1790918936.881025:0:5825:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.127@tcp-0 is initialized 00000040:01000000:3.0:1790918936.881031:0:5825:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.127@tcp ctxt 1 is initialized 00000100:00080000:0.0:1790918936.881847:0:5841:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1790918936.890383:0:5842:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1790918936.891473:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.127@tcp (uuid 0e69af01-203c-4f0d-87cf-1d5cbb9aaea5) 00000020:00000080:3.0:1790918936.891506:0:5825:0:(genops.c:1384:class_connect()) connect: client 0e69af01-203c-4f0d-87cf-1d5cbb9aaea5, cookie 0xc3296956897c3f42 00000100:00080000:3.0:1790918936.891611:0:5825:0:(import.c:545:import_select_connection()) MGC192.168.201.127@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790918936.891623:0:5825:0:(import.c:666:import_select_connection()) MGC192.168.201.127@tcp: import 00000000d96b77eb using connection 192.168.201.127@tcp/0@lo 00000100:00100000:3.0:1790918936.891679:0:5825:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000530effe4 x1877914550272128/t0(0) o250->MGC192.168.201.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790918936.891706:0:5825:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 0e69af01-203c-4f0d-87cf-1d5cbb9aaea5->MGS 00000100:00100000:2.0:1790918936.891856:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000530effe4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3304:1877914550272128:0@lo:250: 00000100:00100000:2.0:1790918936.891945:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918936.892034:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550272128 00000100:00100000:2.0:1790918936.892049:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550272128 00000100:00100000:2.0:1790918936.892080:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790918936.892086:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000b7e0a0ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3304:x1877914550272128:12345-0@lo:250: 00010000:00080000:2.0:1790918936.892104:0:5838:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 0e69af01-203c-4f0d-87cf-1d5cbb9aaea5@0@lo t0 exp 0000000000000000 cur 138 last 0 00000020:00000080:2.0:1790918936.892126:0:5838:0:(genops.c:1384:class_connect()) connect: client 0e69af01-203c-4f0d-87cf-1d5cbb9aaea5, cookie 0xc3296956897c3f49 00000100:00080000:2.0:1790918936.892256:0:5838:0:(import.c:65:import_set_state_nolock()) 000000000d27ebc8 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790918936.892317:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000b7e0a0ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+5:3304:x1877914550272128:12345-0@lo:250: Request processed in 230us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918936.892324:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790918936.892367:0:3304:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.127@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1790918936.892376:0:3304:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.201.127@tcp: connect to target with instance 0 00000100:00080000:2.0:1790918936.892382:0:3304:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.201.127@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1790918936.892386:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1790918936.892389:0:3304:0:(import.c:65:import_set_state_nolock()) 00000000d96b77eb MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1790918936.892391:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1790918936.892400:0:3304:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1790918936.892404:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000530effe4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3304:1877914550272128:0@lo:250: 00000020:01000004:3.0:1790918936.893331:0:5825:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1790918936.893340:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1790918936.893354:0:5825:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000027df6c6c) 00000020:00000080:3.0:1790918936.893366:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1790918936.912117:0:5825:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790918936.912434:0:5825:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1790918936.912440:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1790918936.921801:0:5825:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1790918936.921815:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1790918936.923235:0:5825:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1790918936.923244:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1790918936.927954:0:5825:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790918936.928167:0:5825:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1790918936.928174:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1790918936.940576:0:5825:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1790918936.940704:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1790918937.005506:0:5825:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790918937.005800:0:5825:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1790918937.005808:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1790918937.007261:0:5825:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1790918937.007489:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1790918937.008877:0:5825:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790918937.009058:0:5825:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790918937.009063:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1790918937.009803:0:5825:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790918937.009809:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1790918937.010295:0:5825:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790918937.010451:0:5825:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790918937.010456:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1790918937.013084:0:5825:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790918937.013098:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1790918937.017087:0:5825:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790918937.017290:0:5825:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1790918937.017297:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1790918937.018362:0:5825:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790918937.018372:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1790918937.077754:0:5825:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790918937.078349:0:5825:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1790918937.078356:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1790918937.089293:0:5825:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1790918937.089310:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1790918937.090402:0:5825:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1790918937.090411:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1790918937.097663:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1790918937.097699:0:5825:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1790918937.097704:0:5825:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.127@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1790918937.097837:0:5825:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.127@tcp ctxt 0 is initialized 00000020:01000004:1.0:1790918937.097890:0:5825:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.127@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1790918937.097894:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1790918937.097896:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790918937.097897:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790918937.097899:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790918937.097900:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790918937.097901:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790918937.097902:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790918937.097904:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790918937.097906:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790918937.097907:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790918937.097909:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790918937.097910:0:5825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790918937.097912:0:5825:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1790918937.097914:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790918937.097921:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790918937.097922:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790918937.097923:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790918937.097923:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790918937.097924:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790918937.097925:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790918937.097926:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790918937.097927:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790918937.097928:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790918937.097929:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790918937.097929:0:5825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790918937.097974:0:5825:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1790918937.097992:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006359ef9a pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5825:1877914550272256:0@lo:253: 00000100:00100000:1.0:1790918937.098068:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918937.098106:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 00000000052ded2e going to sleep for 11 seconds 00000100:00100000:0.0:1790918937.098496:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550272256 00000100:00100000:0.0:1790918937.098504:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550272256 00000100:00100000:0.0:1790918937.098575:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790918937.098584:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000009513e760 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+5:5825:x1877914550272256:12345-0@lo:253: 20000000:01000000:0.0:1790918937.098638:0:5840:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1790918937.098641:0:5840:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1790918937.099293:0:5861:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1790918937.099408:0:5840:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1790918937.099754:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790918937.100987:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1790918937.101578:0:5840:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1790918937.101582:0:5840:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1790918937.101588:0:5840:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1790918937.101591:0:5840:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1790918937.101607:0:5840:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1790918937.102007:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790918937.102441:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1790918937.102456:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1790918937.102504:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1790918937.102870:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1790918937.102914:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1790918937.103362:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1790918937.103372:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1790918937.103422:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1790918937.103431:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1790918937.103466:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1790918937.103474:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1790918937.103506:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1790918937.104182:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1790918937.104227:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1790918937.104233:0:5840:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1790918937.104355:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790918937.104646:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1790918937.104668:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1790918937.104705:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1790918937.104737:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1790918937.104785:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1790918937.104796:0:5840:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1790918937.104883:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1790918937.104893:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1790918937.104943:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1790918937.104997:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1790918937.105045:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1790918937.105057:0:5840:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1790918937.105140:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1790918937.105149:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1790918937.105180:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1790918937.105211:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1790918937.105405:0:5840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1790918937.105456:0:5840:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1790918937.105464:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1790918937.107012:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1790918937.107363:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1790918937.107391:0:5840:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.127@tcp for mdt 20000000:01000000:0.0:1790918937.107394:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.127@tcp (null) (null) (null) 00000040:00080000:0.0:1790918937.107432:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1790918937.107440:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1790918937.107469:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1790918937.107476:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.127@tcp (null) (null) 00000040:00080000:0.0:1790918937.107562:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1790918937.107573:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1790918937.107605:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1790918937.107646:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1790918937.107718:0:5840:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1790918937.107721:0:5840:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1790918937.107726:0:5840:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1790918937.107738:0:5840:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1790918937.108662:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:1.0:1790918937.108919:0:5840:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1790918937.118379:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1790918937.118431:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:1.0:1790918937.118504:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:1.0:1790918937.118569:0:5840:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1790918937.118572:0:5840:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1790918937.118576:0:5840:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1790918937.118616:0:5840:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1790918937.118625:0:5840:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1790918937.119927:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1790918937.119930:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1790918937.121203:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:1.0:1790918937.121951:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:1.0:1790918937.121990:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:1.0:1790918937.122055:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:1.0:1790918937.122067:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1790918937.122069:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1790918937.124162:0:5866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1790918937.124433:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1790918937.124479:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1790918937.124508:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:1.0:1790918937.124547:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790918937.124549:0:5840:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:1.0:1790918937.124557:0:5840:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1790918937.124577:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000000cbea5bc/0xc3296956897c3f57 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918937.124594:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000cbea5bc/0xc3296956897c3f57 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918937.124603:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000cbea5bc/0xc3296956897c3f57 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918937.124609:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000cbea5bc/0xc3296956897c3f57 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918937.124615:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000000cbea5bc/0xc3296956897c3f57 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918937.124623:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000000cbea5bc/0xc3296956897c3f57 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918937.124639:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000cbea5bc already unused, calling callback (00000000bbcfb559) 00010000:00010000:1.0:1790918937.124642:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000000cbea5bc/0xc3296956897c3f57 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918937.124660:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000000cbea5bc/0xc3296956897c3f57 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918937.124672:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000000cbea5bc/0xc3296956897c3f57 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918937.124679:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000000cbea5bc/0xc3296956897c3f57 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918937.124684:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000cbea5bc/0xc3296956897c3f57 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790918937.124700:0:5840:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1790918937.359830:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000009513e760 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+5:5825:x1877914550272256:12345-0@lo:253: Request processed in 261240us (261755us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918937.359846:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790918937.359928:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006359ef9a pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5825:1877914550272256:0@lo:253: 10000000:01000000:1.0:1790918937.360011:0:5825:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1790918937.360015:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790918937.360016:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790918937.360018:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790918937.360019:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1790918937.360020:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790918937.360021:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790918937.360023:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790918937.360024:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790918937.360026:0:5825:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1790918937.360027:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790918937.360029:0:5825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1790918937.360050:0:5825:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000fb0ab2a5 from lustre-MDT0000 10000000:01000000:1.0:1790918937.360072:0:5825:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1790918937.360075:0:5825:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1790918937.360079:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff88be88d33380 10000000:01000000:1.0:1790918937.360083:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790918937.360091:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff88be88d33380 from 1 10000000:01000000:1.0:1790918937.360107:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1790918937.360145:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: 000000000cbea5bc/0xc3296956897c3f5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918937.360156:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: 000000000cbea5bc/0xc3296956897c3f5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918937.360164:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: 000000000cbea5bc/0xc3296956897c3f5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790918937.360181:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006359ef9a pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5825:1877914550272384:0@lo:101: 00000100:00100000:1.0:1790918937.360216:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918937.360384:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 000000001505056b going to sleep for 11 seconds 00000100:00100000:2.0:1790918937.360487:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550272384 00000100:00100000:2.0:1790918937.360495:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550272384 00000100:00100000:2.0:1790918937.360644:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790918937.360654:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000e4541e61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+5:5825:x1877914550272384:12345-0@lo:101: 00010000:00010000:2.0:1790918937.360668:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790918937.360690:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cb467969/0xc3296956897c3f65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c3f5e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918937.360712:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cb467969/0xc3296956897c3f65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c3f5e expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918937.360722:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cb467969/0xc3296956897c3f65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c3f5e expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918937.360730:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cb467969, rc 0) 00000100:00100000:2.0:1790918937.360775:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000e4541e61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+6:5825:x1877914550272384:12345-0@lo:101: Request processed in 124us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918937.360781:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790918937.360844:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006359ef9a pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5825:1877914550272384:0@lo:101: 00010000:00010000:1.0:1790918937.360856:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: 000000000cbea5bc/0xc3296956897c3f5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c3f65 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918937.360863:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: 000000000cbea5bc/0xc3296956897c3f5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c3f65 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790918937.360906:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006359ef9a pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5825:1877914550272512:0@lo:501: 00000100:00100000:1.0:1790918937.360929:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918937.361136:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 000000001505056b going to sleep for 11 seconds 00000100:00100000:3.0:1790918937.361180:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550272512 00000100:00100000:3.0:1790918937.361185:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550272512 00000100:00100000:0.0:1790918937.361217:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790918937.361225:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000a60d6f36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+6:5825:x1877914550272512:12345-0@lo:501: 00000100:00100000:0.0:1790918937.361522:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000a60d6f36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+6:5825:x1877914550272512:12345-0@lo:501: Request processed in 298us (592us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790918937.361546:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790918937.361622:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006359ef9a pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5825:1877914550272512:0@lo:501: 10000000:01000000:1.0:1790918937.361644:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1790918937.361661:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: 000000000cbea5bc/0xc3296956897c3f5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c3f65 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918937.361669:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: 000000000cbea5bc/0xc3296956897c3f5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c3f65 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790918937.361685:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff88be91614800 10000000:01000000:1.0:1790918937.361689:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790918937.361693:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff88be91614800 10000000:01000000:1.0:1790918937.361695:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1790918937.361697:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff88be91614800 from 1 10000000:01000000:1.0:1790918937.361700:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1790918937.361717:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: 000000005f97e4f2/0xc3296956897c3f6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918937.361724:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: 000000005f97e4f2/0xc3296956897c3f6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918937.361730:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: 000000005f97e4f2/0xc3296956897c3f6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790918937.361742:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006359ef9a pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5825:1877914550272640:0@lo:101: 00000100:00100000:1.0:1790918937.361767:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918937.361785:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 000000001505056b going to sleep for 11 seconds 00000100:00100000:0.0:1790918937.361842:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550272640 00000100:00100000:0.0:1790918937.361847:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550272640 00000100:00100000:0.0:1790918937.361866:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790918937.361870:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000295f34ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+6:5825:x1877914550272640:12345-0@lo:101: 00010000:00010000:0.0:1790918937.361879:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790918937.361890:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f8be0d00/0xc3296956897c3f73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c3f6c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918937.361906:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f8be0d00/0xc3296956897c3f73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c3f6c expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918937.361914:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f8be0d00/0xc3296956897c3f73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c3f6c expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918937.361921:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f8be0d00, rc 0) 00000100:00100000:0.0:1790918937.362026:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000295f34ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+7:5825:x1877914550272640:12345-0@lo:101: Request processed in 155us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918937.362033:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790918937.362102:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006359ef9a pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5825:1877914550272640:0@lo:101: 00010000:00010000:1.0:1790918937.362112:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: 000000005f97e4f2/0xc3296956897c3f6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c3f73 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918937.362119:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: 000000005f97e4f2/0xc3296956897c3f6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c3f73 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790918937.362130:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1790918937.362142:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: 000000005f97e4f2/0xc3296956897c3f6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c3f73 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918937.362158:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: 000000005f97e4f2/0xc3296956897c3f6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c3f73 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790918937.362164:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1790918937.362168:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790918937.362171:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff88be91614800 10000000:01000000:1.0:1790918937.362173:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1790918937.362176:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1790918937.362177:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1790918937.362191:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: 000000009ec66ae6/0xc3296956897c3f7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918937.362196:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: 000000009ec66ae6/0xc3296956897c3f7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918937.362202:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: 000000009ec66ae6/0xc3296956897c3f7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790918937.362211:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006359ef9a pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5825:1877914550272768:0@lo:101: 00000100:00100000:1.0:1790918937.362235:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918937.362245:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 000000001505056b going to sleep for 11 seconds 00000100:00100000:0.0:1790918937.362363:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550272768 00000100:00100000:0.0:1790918937.362367:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550272768 00000100:00100000:0.0:1790918937.362382:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790918937.362386:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000003fd40773 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+7:5825:x1877914550272768:12345-0@lo:101: 00010000:00010000:0.0:1790918937.362392:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790918937.362398:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008680a0d9/0xc3296956897c3f81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c3f7a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918937.362409:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008680a0d9/0xc3296956897c3f81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c3f7a expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918937.362415:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008680a0d9/0xc3296956897c3f81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c3f7a expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918937.362421:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008680a0d9, rc 0) 00000100:00100000:0.0:1790918937.362454:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000003fd40773 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+8:5825:x1877914550272768:12345-0@lo:101: Request processed in 68us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918937.362459:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790918937.362588:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006359ef9a pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5825:1877914550272768:0@lo:101: 00010000:00010000:1.0:1790918937.362597:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: 000000009ec66ae6/0xc3296956897c3f7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c3f81 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918937.362604:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: 000000009ec66ae6/0xc3296956897c3f7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c3f81 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790918937.362649:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006359ef9a pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5825:1877914550272896:0@lo:501: 00000100:00100000:1.0:1790918937.362670:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918937.362683:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 000000001505056b going to sleep for 11 seconds 00000100:00100000:0.0:1790918937.362727:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550272896 00000100:00100000:0.0:1790918937.362730:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550272896 00000100:00100000:0.0:1790918937.362756:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790918937.362762:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000ba21131f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+8:5825:x1877914550272896:12345-0@lo:501: 00000100:00100000:0.0:1790918937.363069:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000ba21131f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+9:5825:x1877914550272896:12345-0@lo:501: Request processed in 308us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918937.363078:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790918937.363205:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006359ef9a pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5825:1877914550272896:0@lo:501: 00000100:00100000:1.0:1790918937.363234:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006359ef9a pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5825:1877914550273024:0@lo:503: 00000100:00100000:1.0:1790918937.363339:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918937.363357:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 000000001505056b going to sleep for 11 seconds 00000100:00100000:0.0:1790918937.363406:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550273024 00000100:00100000:0.0:1790918937.363410:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550273024 00000100:00100000:0.0:1790918937.363474:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790918937.363480:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000061fe0860 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+9:5825:x1877914550273024:12345-0@lo:503: 00000100:00100000:0.0:1790918937.363664:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000061fe0860 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+9:5825:x1877914550273024:12345-0@lo:503: Request processed in 185us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918937.363671:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790918937.363844:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006359ef9a pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5825:1877914550273024:0@lo:503: 00000100:00100000:1.0:1790918937.364582:0:5870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006359ef9a pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5870:1877914550273152:0@lo:502: 00000100:00100000:1.0:1790918937.364626:0:5870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918937.364660:0:5870:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bd784484 going to sleep for 11 seconds 00000100:00100000:3.0:1790918937.364738:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550273152 00000100:00100000:3.0:1790918937.364743:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550273152 00000100:00100000:3.0:1790918937.364776:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790918937.364783:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000084544efb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+9:5870:x1877914550273152:12345-0@lo:502: 00000100:00100000:3.0:1790918937.365106:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000084544efb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+9:5870:x1877914550273152:12345-0@lo:502: Request processed in 323us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918937.365113:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790918937.365195:0:5870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006359ef9a pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5870:1877914550273152:0@lo:502: 00000020:01000000:1.0:1790918937.365219:0:5870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790918937.365230:0:5870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790918937.365232:0:5870:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1790918937.365237:0:5870:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1790918937.365240:0:5870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790918937.365352:0:5870:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000067ffc5d1) 00000020:00000080:1.0:1790918937.365370:0:5870:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1790918937.365378:0:5870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1790918937.365481:0:5870:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1790918937.365489:0:5870:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3296956897c3f8f 00000020:00000080:1.0:1790918937.365745:0:5870:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1790918937.365750:0:5870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790918937.365754:0:5870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790918937.365761:0:5870:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1790918937.365764:0:5870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790918937.365768:0:5870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790918937.365770:0:5870:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1790918937.365772:0:5870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790918937.365780:0:5870:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000002cae53f8) 00000020:00000080:1.0:1790918937.365790:0:5870:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1790918937.365794:0:5870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1790918937.365796:0:5870:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1790918937.365799:0:5870:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1790918937.365805:0:5870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790918937.365856:0:5870:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000fb0ab2a5 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1790918937.365868:0:5870:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000d12be077) 00000020:00000080:1.0:1790918937.365874:0:5870:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1790918937.365926:0:5870:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1790918937.365932:0:5870:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3296956897c3fa4 00000020:00000080:1.0:1790918937.366088:0:5870:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1790918937.366093:0:5870:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1790918937.366097:0:5870:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc3296956897c3fab 00080000:01000000:1.0:1790918937.366101:0:5870:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1790918937.366104:0:5870:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3296956897c3fb2 00080000:10000000:1.0:1790918937.366783:0:5870:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1790918937.367061:0:5870:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1790918937.373663:0:5870:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1790918937.439035:0:5870:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1790918937.439461:0:5870:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1790918937.441840:0:5870:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1790918937.442131:0:5870:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1790918937.526744:0:5870:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000009c728228) 00000020:00000080:2.0:1790918937.526769:0:5870:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1790918937.526847:0:5870:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1790918937.526854:0:5870:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3296956897c3fc0 00000020:00000080:2.0:1790918937.530256:0:5870:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1790918937.536306:0:5870:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1790918937.635978:0:5870:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1790918937.668988:0:5870:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1790918937.700423:0:5870:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1790918937.752375:0:5870:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1790918937.783144:0:5870:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1790918937.822319:0:5870:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc3296956897c3fc7 00000020:00000080:3.0:1790918937.822771:0:5870:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1790918937.822783:0:5870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790918937.822789:0:5870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790918937.822791:0:5870:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1790918937.822801:0:5870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790918937.822806:0:5870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790918937.822807:0:5870:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1790918937.822811:0:5870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1790918937.822847:0:5870:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1790918937.822861:0:5870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790918937.822864:0:5870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790918937.822865:0:5870:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1790918937.822867:0:5870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790918937.822869:0:5870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790918937.822871:0:5870:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790918937.822873:0:5870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790918937.822875:0:5870:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1790918937.822914:0:5870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000804dc47c pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5870:1877914550273280:0@lo:502: 00000100:00100000:3.0:1790918937.822995:0:5870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918937.823161:0:5870:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e7a5e9ca going to sleep for 11 seconds 00000100:00100000:1.0:1790918937.823374:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550273280 00000100:00100000:1.0:1790918937.823382:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550273280 00000100:00100000:1.0:1790918937.823457:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790918937.823466:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000005619e842 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+9:5870:x1877914550273280:12345-0@lo:502: 00000100:00100000:1.0:1790918937.825119:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000005619e842 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+9:5870:x1877914550273280:12345-0@lo:502: Request processed in 1649us (2118us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918937.825134:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790918937.825368:0:5870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000804dc47c pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5870:1877914550273280:0@lo:502: 00000020:01000000:2.0:1790918937.825401:0:5870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790918937.825409:0:5870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790918937.825411:0:5870:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:2.0:1790918937.825416:0:5870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1790918937.825608:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1790918937.825627:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1790918937.825650:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: 000000009ec66ae6/0xc3296956897c3f7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c3f81 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918937.825661:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: 000000009ec66ae6/0xc3296956897c3f7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c3f81 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790918937.825668:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88be91614800 from 1 10000000:01000000:3.0:1790918937.825670:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790918937.825706:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: 000000003439f9ed/0xc3296956897c3fce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918937.825714:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: 000000003439f9ed/0xc3296956897c3fce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918937.825736:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: 000000003439f9ed/0xc3296956897c3fce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790918937.825753:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b7e6a3d5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5825:1877914550273408:0@lo:101: 00000100:00100000:3.0:1790918937.825800:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918937.825828:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 000000003618288e going to sleep for 11 seconds 00000100:00100000:3.0:1790918937.825849:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550273408 00000100:00100000:3.0:1790918937.825855:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550273408 00000100:00100000:3.0:1790918937.825885:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790918937.825892:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000009fdbe3a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+9:5825:x1877914550273408:12345-0@lo:101: 00010000:00010000:3.0:1790918937.825903:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790918937.825915:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c9699464/0xc3296956897c3fd5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c3fce expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918937.825934:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c9699464/0xc3296956897c3fd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c3fce expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918937.825944:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c9699464/0xc3296956897c3fd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c3fce expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918937.825951:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c9699464, rc 0) 00000100:00100000:3.0:1790918937.825982:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000009fdbe3a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+10:5825:x1877914550273408:12345-0@lo:101: Request processed in 91us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918937.825988:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790918937.826136:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b7e6a3d5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5825:1877914550273408:0@lo:101: 00010000:00010000:3.0:1790918937.826148:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: 000000003439f9ed/0xc3296956897c3fce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c3fd5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918937.826165:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: 000000003439f9ed/0xc3296956897c3fce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c3fd5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790918937.826794:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b7e6a3d5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5825:1877914550273536:0@lo:256: 00000100:00100000:3.0:1790918937.826832:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918937.826928:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 000000003618288e going to sleep for 11 seconds 00000100:00100000:1.0:1790918937.828202:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550273536 00000100:00100000:1.0:1790918937.828213:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550273536 00000100:00100000:1.0:1790918937.828587:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790918937.828595:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000026d7a55e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+10:5825:x1877914550273536:12345-0@lo:256: 20000000:01000000:1.0:1790918937.828618:0:5840:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1790918937.828624:0:5840:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1790918937.829156:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000026d7a55e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+10:5825:x1877914550273536:12345-0@lo:256: Request processed in 560us (2321us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918937.829164:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790918937.829331:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b7e6a3d5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5825:1877914550273536:0@lo:256: 10000000:01000000:2.0:1790918937.829954:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790918937.829966:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: 000000003439f9ed/0xc3296956897c3fce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c3fd5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918937.829978:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: 000000003439f9ed/0xc3296956897c3fce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c3fd5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790918937.829985:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88be91614800 from 1 10000000:01000000:2.0:1790918937.829988:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790918937.831133:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: 0000000069d428d7/0xc3296956897c3fdc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918937.831147:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: 0000000069d428d7/0xc3296956897c3fdc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918937.831156:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: 0000000069d428d7/0xc3296956897c3fdc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790918937.831176:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c6105f05 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5825:1877914550273664:0@lo:101: 00000100:00100000:2.0:1790918937.831232:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918937.831372:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 000000009acd331c going to sleep for 11 seconds 00000100:00100000:3.0:1790918937.831727:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550273664 00000100:00100000:3.0:1790918937.831736:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550273664 00000100:00100000:3.0:1790918937.831782:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790918937.831789:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000eacb3233 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+10:5825:x1877914550273664:12345-0@lo:101: 00010000:00010000:3.0:1790918937.831802:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790918937.831815:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000008ee7f4a/0xc3296956897c3fe3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c3fdc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918937.831837:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000008ee7f4a/0xc3296956897c3fe3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c3fdc expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918937.831847:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000008ee7f4a/0xc3296956897c3fe3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c3fdc expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918937.831854:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000008ee7f4a, rc 0) 00000100:00100000:3.0:1790918937.831891:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000eacb3233 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+11:5825:x1877914550273664:12345-0@lo:101: Request processed in 102us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918937.831898:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790918937.831985:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c6105f05 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5825:1877914550273664:0@lo:101: 00010000:00010000:2.0:1790918937.831999:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: 0000000069d428d7/0xc3296956897c3fdc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c3fe3 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918937.832007:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: 0000000069d428d7/0xc3296956897c3fdc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c3fe3 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790918937.832156:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c6105f05 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5825:1877914550273792:0@lo:501: 00000100:00100000:2.0:1790918937.832193:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918937.832220:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 000000009acd331c going to sleep for 11 seconds 00000100:00100000:1.0:1790918937.832279:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550273792 00000100:00100000:1.0:1790918937.832283:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550273792 00000100:00100000:1.0:1790918937.832313:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790918937.832319:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000009df2a1d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+11:5825:x1877914550273792:12345-0@lo:501: 00000100:00100000:1.0:1790918937.843811:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000009df2a1d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+11:5825:x1877914550273792:12345-0@lo:501: Request processed in 11484us (11609us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918937.843826:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790918937.843956:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c6105f05 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5825:1877914550273792:0@lo:501: 00000100:00100000:3.0:1790918937.844181:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005b34f4e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5825:1877914550273920:0@lo:503: 00000100:00100000:3.0:1790918937.844233:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918937.844375:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 0000000079c1a300 going to sleep for 11 seconds 00000100:00100000:2.0:1790918937.844448:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550273920 00000100:00100000:2.0:1790918937.844455:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550273920 00000100:00100000:2.0:1790918937.844840:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790918937.844851:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000638b099c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+11:5825:x1877914550273920:12345-0@lo:503: 00000040:00080000:2.0:1790918937.844900:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790918937.844965:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000638b099c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+11:5825:x1877914550273920:12345-0@lo:503: Request processed in 117us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918937.844972:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790918937.845053:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005b34f4e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5825:1877914550273920:0@lo:503: 00000040:00080000:0.0:1790918937.847234:0:5874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1790918937.847989:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1790918937.848079:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790918937.848098:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: 0000000069d428d7/0xc3296956897c3fdc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c3fe3 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918937.848111:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: 0000000069d428d7/0xc3296956897c3fdc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c3fe3 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790918937.848156:0:5825:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1790918937.848159:0:5825:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff88be91614800 10000000:01000000:1.0:1790918937.848161:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff88be91614800 10000000:01000000:1.0:1790918937.848164:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790918937.848170:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88be91614800 from 1 10000000:01000000:1.0:1790918937.848172:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790918937.848205:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: 00000000f462e5f7/0xc3296956897c3fea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918937.848226:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: 00000000f462e5f7/0xc3296956897c3fea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918937.848236:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: 00000000f462e5f7/0xc3296956897c3fea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790918937.848355:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006359ef9a pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5825:1877914550274048:0@lo:101: 00000100:00100000:1.0:1790918937.848416:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918937.848540:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 000000009e1fcba9 going to sleep for 11 seconds 00000100:00100000:2.0:1790918937.848739:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550274048 00000100:00100000:2.0:1790918937.848748:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550274048 00000100:00100000:3.0:1790918937.848852:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790918937.848861:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000d3a58dad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+11:5825:x1877914550274048:12345-0@lo:101: 00010000:00010000:3.0:1790918937.848875:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790918937.848887:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000053d7ba22/0xc3296956897c3ff1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c3fea expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918937.848907:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000053d7ba22/0xc3296956897c3ff1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c3fea expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918937.848916:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000053d7ba22/0xc3296956897c3ff1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c3fea expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918937.848924:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000053d7ba22, rc 0) 00000100:00100000:3.0:1790918937.848968:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000d3a58dad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:5825:x1877914550274048:12345-0@lo:101: Request processed in 108us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918937.848974:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790918937.849133:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006359ef9a pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5825:1877914550274048:0@lo:101: 00010000:00010000:1.0:1790918937.849147:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: 00000000f462e5f7/0xc3296956897c3fea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c3ff1 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918937.849155:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: 00000000f462e5f7/0xc3296956897c3fea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c3ff1 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790918937.849200:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006359ef9a pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5825:1877914550274176:0@lo:501: 00000100:00100000:1.0:1790918937.849224:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918937.849241:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 000000009e1fcba9 going to sleep for 11 seconds 00000100:00100000:3.0:1790918937.849354:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550274176 00000100:00100000:3.0:1790918937.849358:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550274176 00000100:00100000:3.0:1790918937.849374:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790918937.849379:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000adbddfa4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:5825:x1877914550274176:12345-0@lo:501: 00000100:00100000:3.0:1790918937.849662:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000adbddfa4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:5825:x1877914550274176:12345-0@lo:501: Request processed in 282us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918937.849669:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790918937.849917:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006359ef9a pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5825:1877914550274176:0@lo:501: 00000100:00100000:1.0:1790918937.849945:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006359ef9a pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5825:1877914550274304:0@lo:503: 00000100:00100000:1.0:1790918937.849982:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918937.850001:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 000000009e1fcba9 going to sleep for 11 seconds 00000100:00100000:3.0:1790918937.850184:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550274304 00000100:00100000:3.0:1790918937.850189:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550274304 00000100:00100000:3.0:1790918937.850209:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790918937.850215:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000026cc1230 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:5825:x1877914550274304:12345-0@lo:503: 00000100:00100000:3.0:1790918937.850566:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000026cc1230 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:5825:x1877914550274304:12345-0@lo:503: Request processed in 351us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918937.850579:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790918937.850766:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006359ef9a pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5825:1877914550274304:0@lo:503: 00000100:00100000:3.0:1790918937.851237:0:5875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005506004c pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5875:1877914550274432:0@lo:502: 00000100:00100000:3.0:1790918937.851287:0:5875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918937.851315:0:5875:0:(client.c:2716:ptlrpc_set_wait()) set 00000000aad2b31b going to sleep for 11 seconds 00000100:00100000:2.0:1790918937.851402:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550274432 00000100:00100000:2.0:1790918937.851407:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550274432 00000100:00100000:2.0:1790918937.851442:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790918937.851449:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000006b8665cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:5875:x1877914550274432:12345-0@lo:502: 00000100:00100000:2.0:1790918937.851825:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000006b8665cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:5875:x1877914550274432:12345-0@lo:502: Request processed in 377us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918937.851833:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790918937.851907:0:5875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005506004c pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5875:1877914550274432:0@lo:502: 00000020:01000004:1.0:1790918937.851962:0:5875:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1790918937.851976:0:5875:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000091b6c3e8) 00000020:00000080:1.0:1790918937.851996:0:5875:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1790918937.852072:0:5875:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000fb0ab2a5 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1790918937.852076:0:5875:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000fb0ab2a5 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1790918937.852079:0:5875:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000fb0ab2a5 4 00010000:00080000:1.0:1790918937.852103:0:5875:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000f6f18679@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.127@tcp at head 00010000:00010000:1.0:1790918937.853718:0:5875:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1790918937.853917:0:5875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1790918937.853949:0:5875:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790918937.853961:0:5875:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc3296956897c3fff 00000100:00080000:1.0:1790918937.853971:0:5875:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790918937.853979:0:5875:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000f6f18679 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:1.0:1790918937.854012:0:5875:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006359ef9a x1877914550274560/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790918937.854052:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006359ef9a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877914550274560:0@lo:38: 00000100:00100000:1.0:1790918937.854113:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918937.854179:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550274560 00000100:00100000:1.0:1790918937.854186:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550274560 00000100:00100000:1.0:1790918937.854226:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790918937.854232:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000001c02d7b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1877914550274560:12345-0@lo:38: 00000100:00100000:1.0:1790918937.854277:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000001c02d7b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1877914550274560:12345-0@lo:38: Request processed in 44us (164us total) trans 0 rc -11/-11 00000100:00100000:1.0:1790918937.854284:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790918937.854314:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790918937.854322:0:3304:0:(import.c:65:import_set_state_nolock()) 00000000f6f18679 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790918937.854336:0:3304:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1790918937.854339:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006359ef9a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877914550274560:0@lo:38: 00000100:00080000:1.0:1790918937.854364:0:5875:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1790918937.857000:0:5875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bffd06cc pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5875:1877914550274688:0@lo:502: 00000100:00100000:3.0:1790918937.857088:0:5875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918937.857120:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550274688 00000100:00100000:3.0:1790918937.857126:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550274688 00000100:00100000:3.0:1790918937.857161:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790918937.857169:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000bcda94ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:5875:x1877914550274688:12345-0@lo:502: 00000100:00100000:3.0:1790918937.857481:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000bcda94ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:5875:x1877914550274688:12345-0@lo:502: Request processed in 312us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918937.857488:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790918937.857575:0:5875:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a6763b12 going to sleep for 11 seconds 00000100:00100000:3.0:1790918937.857594:0:5875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bffd06cc pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5875:1877914550274688:0@lo:502: 00000040:00080000:3.0:1790918937.857690:0:5875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00010000:00010000:2.0:1790918937.858084:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1790918937.858588:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1790918937.858915:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790918937.858937:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: 00000000f462e5f7/0xc3296956897c3fea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c3ff1 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918937.858948:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: 00000000f462e5f7/0xc3296956897c3fea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c3ff1 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790918937.859165:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790918937.859169:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790918937.859170:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790918937.859171:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790918937.859173:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790918937.859174:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790918937.859175:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790918937.859177:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790918937.859178:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790918937.859180:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790918937.859181:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790918937.859183:0:5825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790918937.859186:0:5825:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1790918937.859189:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790918937.859190:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790918937.859191:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790918937.859192:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790918937.859193:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790918937.859195:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790918937.859196:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790918937.859197:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790918937.859198:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790918937.859199:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790918937.859200:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790918937.859201:0:5825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790918937.859224:0:5825:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1790918937.859238:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000771096c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5825:1877914550274816:0@lo:253: 00000100:00100000:2.0:1790918937.859370:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918937.859397:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d7a0a636 going to sleep for 11 seconds 00000100:00100000:3.0:1790918937.859736:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550274816 00000100:00100000:3.0:1790918937.859743:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550274816 00000100:00100000:3.0:1790918937.859788:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790918937.859796:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000454b1ee9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:5825:x1877914550274816:12345-0@lo:253: 20000000:01000000:3.0:1790918937.859820:0:5838:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1790918937.859833:0:5838:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1790918937.895820:0:5838:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790918937.895841:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1790918937.896022:0:5861:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790918937.896028:0:5861:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790918937.896047:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c8c06ed6/0xc3296956897c4006 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918937.896066:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c9699464/0xc3296956897c3fd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c3fce expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918937.896088:0:5861:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c8c06ed6/0xc3296956897c4006 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918937.896127:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c9699464/0xc3296956897c3fd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3296956897c3fce expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918937.896142:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c9699464/0xc3296956897c3fd5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3296956897c3fce expref: 12 pid: 5839 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790918937.896155:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e213b227 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1877914550274944:0@lo:104: 00000100:00100000:2.0:1790918937.896218:0:5861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918937.896295:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550274944 00000100:00100000:1.0:1790918937.896304:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550274944 00000100:00100000:1.0:1790918937.896357:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790918937.896367:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000075fa8f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+3:5861:x1877914550274944:12345-0@lo:104: 00010000:00010000:1.0:1790918937.896380:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.127@tcp lock: 000000003439f9ed/0xc3296956897c3fce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c3fd5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918937.896425:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790918937.896430:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000075fa8f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+3:5861:x1877914550274944:12345-0@lo:104: Request processed in 65us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918937.896436:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1790918937.896437:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790918937.896443:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: 000000003439f9ed/0xc3296956897c3fce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c3fd5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918937.896460:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003439f9ed already unused, calling callback (000000006c7a9c20) 10000000:00010000:3.0:1790918937.896463:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: 000000003439f9ed/0xc3296956897c3fce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3296956897c3fd5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918937.896470:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: 000000003439f9ed/0xc3296956897c3fce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3296956897c3fd5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790918937.896476:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: 000000003439f9ed/0xc3296956897c3fce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3296956897c3fd5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790918937.896481:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790918937.896519:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: 000000003439f9ed/0xc3296956897c3fce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c3fd5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918937.896545:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790918937.896561:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: 000000003439f9ed/0xc3296956897c3fce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c3fd5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918937.896567:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: 000000003439f9ed/0xc3296956897c3fce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c3fd5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918937.896584:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790918937.896585:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790918937.896587:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790918937.896681:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790918937.896691:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bffd06cc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550275072:0@lo:103: 00000100:00100000:3.0:1790918937.896719:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918937.896787:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e032455f going to sleep for 11 seconds 00000100:00100000:1.0:1790918937.896806:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550275072 00000100:00100000:2.0:1790918937.896809:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e213b227 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1877914550274944:0@lo:104: 00000100:00100000:1.0:1790918937.896811:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550275072 00010000:00010000:2.0:1790918937.896826:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c8c06ed6/0xc3296956897c4006 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918937.896826:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c9699464/0xc3296956897c3fd5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c3fce expref: 13 pid: 5839 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790918937.896854:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790918937.896860:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000d8a1eb21 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:3305:x1877914550275072:12345-0@lo:103: 00010000:00010000:1.0:1790918937.896869:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790918937.896872:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c9699464/0xc3296956897c3fd5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c3fce expref: 13 pid: 5839 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918937.896881:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c9699464/0xc3296956897c3fd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3296956897c3fce expref: 13 pid: 5839 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918937.896893:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c9699464/0xc3296956897c3fd5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3296956897c3fce expref: 13 pid: 5839 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918937.896913:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c8c06ed6/0xc3296956897c4006 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918937.896920:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c8c06ed6/0xc3296956897c4006 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790918937.896932:0:5829:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000905048s 00010000:00010000:1.0:1790918937.896935:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c8c06ed6/0xc3296956897c4006 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918937.896941:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c8c06ed6/0xc3296956897c4006 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918937.896947:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c8c06ed6/0xc3296956897c4006 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918937.896953:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c8c06ed6/0xc3296956897c4006 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918937.896958:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c8c06ed6 already unused, calling callback (00000000bbcfb559) 00010000:00010000:1.0:1790918937.896961:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c8c06ed6/0xc3296956897c4006 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918937.896968:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c8c06ed6/0xc3296956897c4006 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918937.896986:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c8c06ed6/0xc3296956897c4006 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918937.896996:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790918937.897015:0:5861:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c8c06ed6/0xc3296956897c4006 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918937.897022:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c8c06ed6/0xc3296956897c4006 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918937.897027:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c8c06ed6/0xc3296956897c4006 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790918937.897212:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000d8a1eb21 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:3305:x1877914550275072:12345-0@lo:103: Request processed in 352us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918937.897220:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790918937.897513:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bffd06cc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550275072:0@lo:103: 00000100:00100000:0.0:1790918937.913411:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000454b1ee9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+11:5825:x1877914550274816:12345-0@lo:253: Request processed in 53610us (54035us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918937.913424:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790918937.913570:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000771096c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5825:1877914550274816:0@lo:253: 10000000:01000000:2.0:1790918937.913585:0:5825:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1790918937.913589:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790918937.913603:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790918937.913605:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790918937.913606:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790918937.913677:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790918937.913679:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790918937.913681:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790918937.913682:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790918937.913684:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790918937.913685:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790918937.913687:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790918937.913688:0:5825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790918937.913703:0:5825:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1790918937.919586:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1790918937.919966:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1790918937.920887:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1790918937.921237:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1790918937.921850:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1790918937.922097:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1790918937.922994:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1790918937.923407:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1790918937.924427:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1790918937.924755:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1790918937.924889:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1790918937.925081:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1790918937.978437:0:5825:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1790918938.007976:0:5825:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1790918938.008110:0:5880:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1790918938.008113:0:5880:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1790918938.008207:0:5881:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1790918938.010655:0:5825:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1790918938.010812:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1790918938.011275:0:5825:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1790918938.011282:0:5825:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1790918938.011398:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790918938.012410:0:5825:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1790918938.021098:0:5825:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1790918938.021195:0:5825:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1790918938.021986:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1790918938.022649:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1790918938.023975:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1790918938.024106:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1790918938.025288:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1790918938.025555:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1790918938.025700:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1790918938.025839:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1790918938.026009:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1790918938.026374:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1790918938.026585:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1790918938.026735:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1790918938.026871:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1790918938.026987:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1790918938.027124:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1790918938.027230:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1790918938.029360:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1790918938.029502:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1790918938.030101:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1790918938.030184:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1790918938.030317:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1790918938.030461:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1790918938.030617:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1790918938.030746:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1790918938.030861:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1790918938.031006:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1790918938.031131:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1790918938.031223:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1790918938.031314:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1790918938.031406:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1790918938.031587:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1790918938.031731:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1790918938.031825:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1790918938.031925:0:5825:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1790918938.032124:0:5825:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1790918938.045777:0:5881:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1790918938.083940:0:5825:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1790918938.083978:0:5825:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9f1701c47988 00100000:10000000:1.0:1790918938.083986:0:5825:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1790918938.085157:0:5825:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790918938.085172:0:5825:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.127@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790918938.085186:0:5825:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1790918938.085209:0:5825:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1790918938.161760:0:5881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1790918938.161839:0:5881:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1790918938.161844:0:5881:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1790918938.881999:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790918939.904700:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790918940.929864:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790918941.953349:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790918942.774513:0:6123:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg127-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1790918942.977036:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790918942.977599:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1790918942.977613:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1790918942.977616:0:8:0:(import.c:65:import_set_state_nolock()) 00000000f6f18679 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790918942.977633:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000f6f18679 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:1.0:1790918942.977656:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002f3a5f80 x1877914550275328/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790918942.977690:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002f3a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877914550275328:0@lo:38: 00000100:00100000:1.0:1790918942.977785:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918942.978119:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006359ef9a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3307:1877914550275200:0@lo:400: 00000100:00100000:3.0:1790918942.978157:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790918942.978560:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550275328 00000100:00100000:0.0:1790918942.978578:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550275328 00000100:00100000:0.0:1790918942.978621:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790918942.978629:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000005269e091 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1877914550275328:12345-0@lo:38: 00010000:00080000:0.0:1790918942.978654:0:5847:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 144 last 0 00000020:00000080:0.0:1790918942.978687:0:5847:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc3296956897c400d 00000004:00100000:0.0:1790918942.978763:0:5847:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790918942.978883:0:5847:0:(import.c:65:import_set_state_nolock()) 000000007e6e1b7b : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790918942.978949:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000005269e091 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877914550275328:12345-0@lo:38: Request processed in 320us (1164us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918942.978957:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790918942.978998:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000002f3a5f80 x1877914550275328/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790918952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790918942.979015:0:3304:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1790918942.979022:0:3304:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1790918942.979026:0:3304:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790918942.979028:0:3304:0:(import.c:65:import_set_state_nolock()) 00000000f6f18679 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790918942.979034:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002f3a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877914550275328:0@lo:38: 00000100:00100000:1.0:1790918942.981148:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550275200 00000100:00100000:1.0:1790918942.981163:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550275200 00000100:00100000:1.0:1790918942.981214:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790918942.981222:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000986b6c41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+11:3307:x1877914550275200:12345-0@lo:400: 00000100:00100000:1.0:1790918942.981303:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000986b6c41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+11:3307:x1877914550275200:12345-0@lo:400: Request processed in 83us (3146us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918942.981311:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790918942.983810:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006359ef9a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3307:1877914550275200:0@lo:400: 10000000:01000000:0.0:1790918943.494036:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790918943.494042:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88be91614800 from 3 10000000:01000000:0.0:1790918943.494046:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790918943.494110:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: 000000000da777a7/0xc3296956897c4014 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918943.494122:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: 000000000da777a7/0xc3296956897c4014 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918943.494132:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: 000000000da777a7/0xc3296956897c4014 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790918943.494275:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005a8e7ab7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550275456:0@lo:101: 00000100:00100000:0.0:1790918943.494344:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790918943.494392:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 000000000e81d370 going to sleep for 11 seconds 00000100:00100000:1.0:1790918943.495562:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550275456 00000100:00100000:1.0:1790918943.495573:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550275456 00000100:00100000:1.0:1790918943.495615:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790918943.495623:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000008508a3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+11:5842:x1877914550275456:12345-0@lo:101: 00010000:00010000:1.0:1790918943.495638:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790918943.495653:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f64d7815/0xc3296956897c401b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c4014 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918943.495678:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f64d7815/0xc3296956897c401b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c4014 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918943.495688:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f64d7815/0xc3296956897c401b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c4014 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918943.495707:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f64d7815, rc 0) 00000100:00100000:1.0:1790918943.495763:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000008508a3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:5842:x1877914550275456:12345-0@lo:101: Request processed in 141us (1420us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918943.495770:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790918943.495821:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005a8e7ab7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550275456:0@lo:101: 00010000:00010000:1.0:1790918943.495836:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: 000000000da777a7/0xc3296956897c4014 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c401b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918943.495844:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: 000000000da777a7/0xc3296956897c4014 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c401b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790918943.495895:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000004d5aa41 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550275584:0@lo:256: 00000100:00100000:0.0:1790918943.500267:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790918943.500310:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 000000004424147a going to sleep for 11 seconds 00000100:00100000:0.0:1790918943.500331:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550275584 00000100:00100000:0.0:1790918943.500339:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550275584 00000100:00100000:0.0:1790918943.500377:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790918943.500384:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000003d2afeb0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:5842:x1877914550275584:12345-0@lo:256: 20000000:01000000:0.0:1790918943.500418:0:5839:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790918943.500434:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790918943.500442:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1790918943.500554:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000003d2afeb0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:5842:x1877914550275584:12345-0@lo:256: Request processed in 171us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918943.500562:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790918943.500605:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000004d5aa41 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550275584:0@lo:256: 10000000:01000000:0.0:1790918943.500655:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790918943.500663:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: 000000000da777a7/0xc3296956897c4014 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c401b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918943.500673:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: 000000000da777a7/0xc3296956897c4014 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c401b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918944.000263:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790918945.026000:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790918946.057158:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790918947.073602:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790918947.468965:0:6326:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff11f3b8d0 20000000:00000080:1.0:1790918947.468981:0:6326:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff88be8715f800 uarg=0000000000000000 20000000:01000000:1.0:1790918947.469014:0:6326:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1790918947.469021:0:6326:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1790918947.469026:0:6326:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1790918947.469275:0:6326:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1790918947.469289:0:6326:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1790918947.482309:0:6326:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790918947.484168:0:6326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1790918947.484255:0:6326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1790918947.484312:0:6326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1790918947.484348:0:6326:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1790918947.484366:0:6326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000daef85cf/0xc3296956897c4022 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918947.484384:0:6326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000008ee7f4a/0xc3296956897c3fe3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c3fdc expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918947.484391:0:6326:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000daef85cf/0xc3296956897c4022 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918947.484430:0:6326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000008ee7f4a/0xc3296956897c3fe3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3296956897c3fdc expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918947.484444:0:6326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000008ee7f4a/0xc3296956897c3fe3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3296956897c3fdc expref: 11 pid: 5838 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790918947.484467:0:6326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000771096c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6326:1877914550275712:0@lo:104: 00000100:00100000:2.0:1790918947.484895:0:6326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918947.484991:0:6326:0:(client.c:2716:ptlrpc_set_wait()) set 00000000efc53f10 going to sleep for 11 seconds 00000100:00100000:0.0:1790918947.487344:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550275712 00000100:00100000:0.0:1790918947.487358:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550275712 00000100:00100000:0.0:1790918947.487407:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790918947.487415:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000e213b227 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+3:6326:x1877914550275712:12345-0@lo:104: 00010000:00010000:0.0:1790918947.487431:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.127@tcp lock: 0000000069d428d7/0xc3296956897c3fdc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c3fe3 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918947.489731:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790918947.489745:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000e213b227 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+3:6326:x1877914550275712:12345-0@lo:104: Request processed in 2328us (4849us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918947.489758:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1790918947.493317:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790918947.493328:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: 0000000069d428d7/0xc3296956897c3fdc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c3fe3 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918947.493351:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000069d428d7 already unused, calling callback (000000006c7a9c20) 10000000:00010000:3.0:1790918947.493355:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: 0000000069d428d7/0xc3296956897c3fdc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3296956897c3fe3 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918947.493364:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: 0000000069d428d7/0xc3296956897c3fdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3296956897c3fe3 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790918947.493372:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: 0000000069d428d7/0xc3296956897c3fdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3296956897c3fe3 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790918947.493378:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790918947.493483:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: 0000000069d428d7/0xc3296956897c3fdc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c3fe3 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918947.493491:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1790918947.493580:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bffd06cc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3308:1877914550275840:0@lo:103: 00000100:00100000:1.0:1790918947.493645:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790918947.493751:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: 0000000069d428d7/0xc3296956897c3fdc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c3fe3 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918947.493760:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: 0000000069d428d7/0xc3296956897c3fdc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c3fe3 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918947.493780:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790918947.493782:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790918947.493784:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790918947.501277:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550275840 00000100:00100000:1.0:1790918947.501294:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550275840 00010000:00010000:1.0:1790918947.501343:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000008ee7f4a/0xc3296956897c3fe3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c3fdc expref: 12 pid: 5838 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790918947.501376:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790918947.501384:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000eb2c4deb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:3308:x1877914550275840:12345-0@lo:103: 00010000:00010000:1.0:1790918947.501398:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790918947.501403:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000008ee7f4a/0xc3296956897c3fe3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c3fdc expref: 12 pid: 5838 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918947.501415:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000008ee7f4a/0xc3296956897c3fe3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3296956897c3fdc expref: 12 pid: 5838 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918947.501433:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000daef85cf/0xc3296956897c4022 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918947.501440:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000daef85cf/0xc3296956897c4022 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918947.501709:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000daef85cf/0xc3296956897c4022 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918947.501716:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000daef85cf/0xc3296956897c4022 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918947.501723:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000daef85cf/0xc3296956897c4022 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918947.501729:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000daef85cf/0xc3296956897c4022 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918947.501750:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000daef85cf already unused, calling callback (00000000bbcfb559) 00010000:00010000:1.0:1790918947.501754:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000daef85cf/0xc3296956897c4022 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918947.501761:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000daef85cf/0xc3296956897c4022 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918947.501770:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000daef85cf/0xc3296956897c4022 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918947.501780:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790918947.501888:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000eb2c4deb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:3308:x1877914550275840:12345-0@lo:103: Request processed in 505us (8243us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918947.501896:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1790918947.502599:0:6326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000008ee7f4a/0xc3296956897c3fe3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3296956897c3fdc expref: 11 pid: 5838 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790918947.502616:0:6326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000771096c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6326:1877914550275712:0@lo:104: 00010000:00010000:2.0:1790918947.502634:0:6326:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000daef85cf/0xc3296956897c4022 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918947.502644:0:6326:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000daef85cf/0xc3296956897c4022 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918947.502659:0:6326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000daef85cf/0xc3296956897c4022 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918947.502664:0:6326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000daef85cf/0xc3296956897c4022 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790918947.505145:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bffd06cc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3308:1877914550275840:0@lo:103: 00010000:00010000:3.0:1790918948.095781:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790918948.104078:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790918948.104102:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000771096c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877914550275968:0@lo:400: 00000100:00100000:2.0:1790918948.104168:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918948.104254:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550275968 00000100:00100000:2.0:1790918948.104260:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550275968 00000100:00100000:2.0:1790918948.104300:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790918948.104308:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000009080c589 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877914550275968:12345-0@lo:400: 00000100:00100000:2.0:1790918948.104371:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000009080c589 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877914550275968:12345-0@lo:400: Request processed in 64us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918948.104379:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1790918948.104420:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000771096c0 x1877914550275968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790918964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790918948.104433:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000771096c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877914550275968:0@lo:400: 00010000:00010000:3.0:1790918949.119805:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790918950.149736:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790918951.168337:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790918952.204080:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790918953.215760:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000771096c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3306:1877914550276096:0@lo:400: 00000100:00100000:2.0:1790918953.215832:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918953.215914:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c42bf7ec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877914550276224:0@lo:400: 00000100:00100000:2.0:1790918953.215943:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918953.215990:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550276096 00000100:00100000:2.0:1790918953.215998:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550276096 00000100:00100000:2.0:1790918953.216051:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790918953.216058:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000008e556991 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+11:3306:x1877914550276096:12345-0@lo:400: 00000100:00100000:2.0:1790918953.216103:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000008e556991 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+11:3306:x1877914550276096:12345-0@lo:400: Request processed in 46us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918953.216110:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790918953.216140:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550276224 00000100:00100000:2.0:1790918953.216143:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550276224 00000100:00100000:2.0:1790918953.216166:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790918953.216171:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000002273d4ed pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877914550276224:12345-0@lo:400: 00000100:00100000:2.0:1790918953.216204:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000002273d4ed pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877914550276224:12345-0@lo:400: Request processed in 32us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918953.216210:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790918953.216255:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c42bf7ec x1877914550276224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790918969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790918953.216269:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c42bf7ec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877914550276224:0@lo:400: 00000100:00100000:2.0:1790918953.216293:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000771096c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3306:1877914550276096:0@lo:400: 10000000:01000000:1.0:1790918953.216668:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790918953.216672:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88be91614800 from 1 10000000:01000000:1.0:1790918953.216676:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790918953.216703:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: 0000000093b64d66/0xc3296956897c4029 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918953.216713:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: 0000000093b64d66/0xc3296956897c4029 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918953.216723:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: 0000000093b64d66/0xc3296956897c4029 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790918953.216737:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b0963a7c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550276352:0@lo:101: 00000100:00100000:1.0:1790918953.216765:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918953.216795:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 0000000078bad303 going to sleep for 11 seconds 00000100:00100000:0.0:1790918953.216988:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550276352 00000100:00100000:0.0:1790918953.216993:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550276352 00000100:00100000:0.0:1790918953.217024:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790918953.217031:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000006b24208a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+11:5842:x1877914550276352:12345-0@lo:101: 00010000:00010000:0.0:1790918953.217040:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790918953.217051:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004156af6a/0xc3296956897c4030 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c4029 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918953.217071:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004156af6a/0xc3296956897c4030 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c4029 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918953.217092:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004156af6a/0xc3296956897c4030 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c4029 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918953.217100:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004156af6a, rc 0) 00000100:00100000:0.0:1790918953.217266:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000006b24208a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:5842:x1877914550276352:12345-0@lo:101: Request processed in 235us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918953.217273:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790918953.217424:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b0963a7c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550276352:0@lo:101: 00010000:00010000:1.0:1790918953.217439:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: 0000000093b64d66/0xc3296956897c4029 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c4030 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918953.217448:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: 0000000093b64d66/0xc3296956897c4029 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c4030 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790918953.217495:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b0963a7c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550276480:0@lo:501: 00000100:00100000:1.0:1790918953.217519:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918953.217554:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 0000000078bad303 going to sleep for 11 seconds 00000100:00100000:2.0:1790918953.217605:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550276480 00000100:00100000:2.0:1790918953.217610:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550276480 00000100:00100000:2.0:1790918953.217641:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790918953.217647:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000070ff1009 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:5842:x1877914550276480:12345-0@lo:501: 00000100:00100000:2.0:1790918953.217893:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000070ff1009 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:5842:x1877914550276480:12345-0@lo:501: Request processed in 246us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918953.217900:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790918953.217928:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b0963a7c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550276480:0@lo:501: 00000100:00100000:2.0:1790918953.217954:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000771096c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550276608:0@lo:503: 00000100:00100000:2.0:1790918953.218225:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918953.218263:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f8f9ea7e going to sleep for 11 seconds 00000100:00100000:1.0:1790918953.218314:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550276608 00000100:00100000:1.0:1790918953.218319:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550276608 00000100:00100000:1.0:1790918953.218348:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790918953.218354:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000006f8610c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:5842:x1877914550276608:12345-0@lo:503: 00000100:00100000:1.0:1790918953.218593:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000006f8610c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:5842:x1877914550276608:12345-0@lo:503: Request processed in 239us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918953.218600:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790918953.218794:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000771096c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550276608:0@lo:503: 00000100:00100000:2.0:1790918953.219240:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000771096c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:6695:1877914550276736:0@lo:502: 00000100:00100000:2.0:1790918953.219278:0:6695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918953.219307:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fbcd1a17 going to sleep for 11 seconds 00000100:00100000:1.0:1790918953.219356:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550276736 00000100:00100000:1.0:1790918953.219361:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550276736 00000100:00100000:1.0:1790918953.219390:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790918953.219396:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000097c69ba2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:6695:x1877914550276736:12345-0@lo:502: 00000100:00100000:1.0:1790918953.219556:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000097c69ba2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:6695:x1877914550276736:12345-0@lo:502: Request processed in 160us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918953.219563:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790918953.219640:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000771096c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:6695:1877914550276736:0@lo:502: 00000020:01000000:2.0:1790918953.219659:0:6695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790918953.219668:0:6695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790918953.219671:0:6695:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1790918953.219678:0:6695:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88be91614800 00000020:00000080:2.0:1790918953.219681:0:6695:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1790918953.219716:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be85f39880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:6695:1877914550276864:0@lo:502: 00000100:00100000:2.0:1790918953.219746:0:6695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918953.219772:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be85efb480 going to sleep for 11 seconds 00010000:00010000:2.0:1790918953.219935:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790918953.220930:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550276864 00000100:00100000:1.0:1790918953.220938:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550276864 00000100:00100000:1.0:1790918953.221036:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790918953.221045:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:6695:x1877914550276864:12345-0@lo:502: 00000100:00100000:1.0:1790918953.221226:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:6695:x1877914550276864:12345-0@lo:502: Request processed in 182us (1478us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918953.221245:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790918953.221346:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be85f39880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:6695:1877914550276864:0@lo:502: 00000020:01000000:2.0:1790918953.221371:0:6695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790918953.221378:0:6695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790918953.221381:0:6695:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1790918953.221385:0:6695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1790918953.221557:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1790918953.221576:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790918953.221585:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be81672e00/0xc3296956897c4029 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c4030 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918953.221597:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88be81672e00/0xc3296956897c4029 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c4030 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790918953.628735:0:6694:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790918953.628739:0:6694:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1790918953.629349:0:6694:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff88be86b70000 00000020:01000004:2.0:1790918953.629367:0:6694:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1790918953.629379:0:6694:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1790918953.629392:0:6694:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff88be88c999c0) 00000020:00000080:2.0:1790918953.629408:0:6694:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1790918953.653212:0:6694:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1790918953.655081:0:6694:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1790918953.681063:0:6694:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1790918953.686042:0:6694:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1790918953.686077:0:6694:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1790918953.686132:0:6694:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1790918953.686158:0:6694:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1790918953.686769:0:6694:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1790918953.686844:0:6694:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790918953.686855:0:6694:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc3296956897c403e 00000020:01000004:2.0:1790918953.686862:0:6694:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1790918953.686881:0:6694:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.127@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790918953.686885:0:6694:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.127@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790918953.686891:0:6694:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1790918953.686895:0:6694:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1790918953.686907:0:6694:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff88be88c98000) 00000020:00000080:2.0:1790918953.686916:0:6694:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1790918953.688326:0:6694:0:(service.c:173:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790918953.688742:0:6694:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1790918953.688749:0:6694:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1790918953.692882:0:6694:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1790918953.692895:0:6694:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1790918953.694500:0:6694:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1790918953.694511:0:6694:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1790918953.696274:0:6694:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790918953.696512:0:6694:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1790918953.696656:0:6694:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1790918953.699289:0:6694:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1790918953.699303:0:6694:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1790918953.747396:0:6694:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790918953.747696:0:6694:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1790918953.747704:0:6694:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1790918953.750341:0:6694:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1790918953.750357:0:6694:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1790918953.751946:0:6694:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1790918953.751956:0:6694:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1790918953.754895:0:6694:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790918953.755177:0:6694:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1790918953.755183:0:6694:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1790918953.756235:0:6694:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1790918953.756245:0:6694:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1790918953.866948:0:6694:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790918953.867173:0:6694:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1790918953.867180:0:6694:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1790918953.869948:0:6694:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1790918953.869963:0:6694:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1790918953.872949:0:6694:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1790918953.873044:0:6694:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1790918953.873052:0:6694:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.127@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1790918953.933206:0:6694:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.127@tcp ctxt 0 is initialized 00000020:01000004:0.0:1790918953.933258:0:6694:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.127@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1790918953.933262:0:6694:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1790918953.933264:0:6694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790918953.933265:0:6694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790918953.933266:0:6694:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790918953.933267:0:6694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790918953.933269:0:6694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790918953.933270:0:6694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790918953.933272:0:6694:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790918953.933273:0:6694:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790918953.933274:0:6694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790918953.933408:0:6694:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790918953.933413:0:6694:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1790918953.933415:0:6694:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790918953.933417:0:6694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790918953.933418:0:6694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790918953.933419:0:6694:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790918953.933420:0:6694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790918953.933421:0:6694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790918953.933422:0:6694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790918953.933429:0:6694:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790918953.933429:0:6694:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790918953.933430:0:6694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790918953.933431:0:6694:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790918953.933455:0:6694:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1790918953.933472:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88d99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:6694:1877914550276992:0@lo:253: 00000100:00100000:0.0:1790918953.933618:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790918953.933725:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be86a73000 going to sleep for 11 seconds 00000100:00100000:2.0:1790918953.933769:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550276992 00000100:00100000:2.0:1790918953.933841:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550276992 00000100:00100000:2.0:1790918953.933935:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790918953.933945:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:6694:x1877914550276992:12345-0@lo:253: 20000000:01000000:2.0:1790918953.934073:0:5840:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1790918953.934077:0:5840:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1790918953.934082:0:5840:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1790918953.934085:0:5840:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1790918953.935854:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790918953.936134:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1790918953.936150:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1790918953.936189:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1790918953.936197:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1790918953.936254:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1790918953.936689:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1790918953.937188:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1790918953.937209:0:5840:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.127@tcp 20000000:01000000:2.0:1790918953.937211:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.127@tcp (null) (null) (null) 00000040:00080000:2.0:1790918953.937260:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1790918953.937268:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1790918953.937448:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1790918953.937456:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.127@tcp (null) (null) 00000040:00080000:2.0:1790918953.937484:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1790918953.937492:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1790918953.937516:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1790918953.937932:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1790918953.939465:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1790918953.939492:0:5840:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.127@tcp 20000000:01000000:2.0:1790918953.939494:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.127@tcp (null) (null) (null) 00000040:00080000:3.0:1790918953.944266:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1790918953.944307:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1790918953.944383:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1790918953.944393:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.127@tcp (null) (null) 00000040:00080000:3.0:1790918953.944468:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1790918953.944479:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1790918953.944513:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1790918953.944573:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1790918953.944595:0:5840:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1790918953.944598:0:5840:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1790918953.944604:0:5840:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1790918953.944605:0:5840:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1790918953.944608:0:5840:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1790918953.944622:0:5840:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1790918953.944624:0:5840:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1790918953.944664:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1790918953.944667:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1790918953.952243:0:6710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1790918953.952661:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1790918953.952706:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1790918953.952986:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1790918953.953006:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1790918953.953008:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1790918953.954581:0:6711:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1790918953.954657:0:6711:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1790918953.954708:0:6711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1790918953.955102:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1790918953.955140:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1790918953.955199:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1790918953.955211:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1790918953.955214:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1790918953.956158:0:6712:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:2.0:1790918953.956216:0:6712:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:2.0:1790918953.956851:0:6712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1790918953.957853:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1790918953.957907:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1790918953.958339:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 10000000:01000000:3.0:1790918953.958364:0:5840:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1790918953.958386:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88be81516600/0xc3296956897c404c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918953.958404:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88be813a2c00/0xc3296956897c3f65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c3f5e expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918953.958423:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88be80031400/0xc3296956897c3f81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c3f7a expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918953.958429:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88be81516800/0xc3296956897c3ff1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c3fea expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918953.958437:0:5840:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88be81516600/0xc3296956897c404c lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918953.958476:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88be81516800/0xc3296956897c3ff1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3296956897c3fea expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918953.958491:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88be81516800/0xc3296956897c3ff1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3296956897c3fea expref: 12 pid: 5839 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790918953.958506:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db4700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1877914550277120:0@lo:104: 00000100:00100000:3.0:1790918953.959153:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790918953.959273:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88be80031400/0xc3296956897c3f81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3296956897c3f7a expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918953.959294:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88be80031400/0xc3296956897c3f81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3296956897c3f7a expref: 12 pid: 5840 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790918953.959303:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db6300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1877914550277248:0@lo:104: 00000100:00100000:3.0:1790918953.959326:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790918953.969325:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88be813a2c00/0xc3296956897c3f65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3296956897c3f5e expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918953.969344:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88be813a2c00/0xc3296956897c3f65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3296956897c3f5e expref: 12 pid: 5839 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790918953.969373:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db7b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1877914550277376:0@lo:104: 00000100:00100000:3.0:1790918953.969427:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918953.969477:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550277120 00000100:00100000:1.0:1790918953.969484:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550277120 00000100:00100000:0.0:1790918953.970672:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550277248 00000100:00100000:0.0:1790918953.970680:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550277248 00000100:00100000:0.0:1790918953.970717:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790918953.970726:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88db5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+4:5840:x1877914550277120:12345-0@lo:104: 00010000:00010000:0.0:1790918953.970742:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.127@tcp lock: ffff88be81673600/0xc3296956897c3fea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c3ff1 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918953.970828:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790918953.970834:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88db5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+4:5840:x1877914550277120:12345-0@lo:104: Request processed in 110us (11684us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918953.970841:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790918953.970861:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790918953.970867:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88db7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+3:5840:x1877914550277248:12345-0@lo:104: 00010000:00010000:0.0:1790918953.970874:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.127@tcp lock: ffff88be81672400/0xc3296956897c3f7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c3f81 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918953.970912:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790918953.970917:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88db7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+3:5840:x1877914550277248:12345-0@lo:104: Request processed in 51us (11591us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918953.970939:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1790918953.971090:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790918953.971099:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff88be81673600/0xc3296956897c3fea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c3ff1 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918953.971108:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81673600 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:2.0:1790918953.971112:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff88be81673600/0xc3296956897c3fea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3296956897c3ff1 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918953.971122:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff88be81673600/0xc3296956897c3fea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3296956897c3ff1 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790918953.971130:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff88be81673600/0xc3296956897c3fea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3296956897c3ff1 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790918953.971136:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790918953.971176:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff88be81673600/0xc3296956897c3fea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c3ff1 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918953.971182:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790918953.971201:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff88be81673600/0xc3296956897c3fea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c3ff1 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918953.971209:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff88be81673600/0xc3296956897c3fea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c3ff1 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918953.971235:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790918953.971239:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff88be81672400/0xc3296956897c3f7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c3f81 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918953.971244:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81672400 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:2.0:1790918953.971247:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff88be81672400/0xc3296956897c3f7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3296956897c3f81 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918953.971263:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff88be81672400/0xc3296956897c3f7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3296956897c3f81 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790918953.971270:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff88be81672400/0xc3296956897c3f7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3296956897c3f81 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790918953.971275:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790918953.971305:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff88be81672400/0xc3296956897c3f7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c3f81 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918953.971311:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790918953.971327:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff88be81672400/0xc3296956897c3f7a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c3f81 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918953.971334:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff88be81672400/0xc3296956897c3f7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c3f81 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918953.971346:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790918953.971348:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790918953.971350:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790918953.971357:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790918953.971372:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be85f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3308:1877914550277504:0@lo:103: 00000100:00100000:2.0:1790918953.971413:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918953.971467:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be85f3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550277632:0@lo:103: 00000100:00100000:2.0:1790918953.971489:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918953.971523:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550277504 00000100:00100000:2.0:1790918953.971543:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550277504 00010000:00010000:2.0:1790918953.971565:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88be81516800/0xc3296956897c3ff1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c3fea expref: 13 pid: 5839 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790918953.971595:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550277632 00000100:00100000:2.0:1790918953.971599:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550277632 00010000:00010000:2.0:1790918953.971610:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88be80031400/0xc3296956897c3f81 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c3f7a expref: 14 pid: 5840 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790918953.971621:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790918953.971626:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be85f3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+14:3308:x1877914550277504:12345-0@lo:103: 00010000:00010000:2.0:1790918953.971636:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790918953.971641:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88be81516800/0xc3296956897c3ff1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c3fea expref: 14 pid: 5839 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918953.971649:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88be81516800/0xc3296956897c3ff1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3296956897c3fea expref: 14 pid: 5839 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918953.971664:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790918953.971691:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be85f3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+14:3308:x1877914550277504:12345-0@lo:103: Request processed in 65us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918953.971697:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790918953.971710:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790918953.971715:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be85f3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:3305:x1877914550277632:12345-0@lo:103: 00010000:00010000:2.0:1790918953.971721:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790918953.971725:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88be80031400/0xc3296956897c3f81 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c3f7a expref: 13 pid: 5840 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918953.971732:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88be80031400/0xc3296956897c3f81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3296956897c3f7a expref: 13 pid: 5840 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918953.971740:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790918953.971769:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be85f3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:3305:x1877914550277632:12345-0@lo:103: Request processed in 53us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918953.971774:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790918953.971804:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be85f3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550277632:0@lo:103: 00000100:00100000:2.0:1790918953.971825:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be85f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3308:1877914550277504:0@lo:103: 00000100:00100000:0.0:1790918953.972508:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550277376 00000100:00100000:0.0:1790918953.972514:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550277376 00000100:00100000:0.0:1790918953.972564:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790918953.972572:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88db4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+3:5840:x1877914550277376:12345-0@lo:104: 00010000:00010000:0.0:1790918953.972583:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.127@tcp lock: ffff88be81672600/0xc3296956897c3f5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c3f65 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918953.972911:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790918953.972917:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88db4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+3:5840:x1877914550277376:12345-0@lo:104: Request processed in 346us (3490us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918953.972923:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1790918953.973080:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790918953.973087:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff88be81672600/0xc3296956897c3f5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c3f65 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918953.973094:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81672600 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:2.0:1790918953.973097:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff88be81672600/0xc3296956897c3f5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3296956897c3f65 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918953.973106:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff88be81672600/0xc3296956897c3f5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3296956897c3f65 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790918953.973113:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff88be81672600/0xc3296956897c3f5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3296956897c3f65 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790918953.973118:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790918953.973191:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff88be81672600/0xc3296956897c3f5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c3f65 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918953.973198:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790918953.973235:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff88be81672600/0xc3296956897c3f5e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c3f65 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918953.973241:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff88be81672600/0xc3296956897c3f5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c3f65 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918953.973269:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790918953.973271:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790918953.973273:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790918953.973633:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be8e1d59c0 going to sleep for 11 seconds 00010000:00010000:2.0:1790918953.973658:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be81516800/0xc3296956897c3ff1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3296956897c3fea expref: 12 pid: 5839 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790918953.973668:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db4700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1877914550277120:0@lo:104: 00010000:00010000:2.0:1790918953.973679:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be80031400/0xc3296956897c3f81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3296956897c3f7a expref: 11 pid: 5840 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790918953.973688:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db6300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1877914550277248:0@lo:104: 00000100:00100000:2.0:1790918953.973694:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db7b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1877914550277376:0@lo:104: 00010000:00010000:2.0:1790918953.973713:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88be81516600/0xc3296956897c404c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790918953.973849:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790918953.973862:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be85f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550277760:0@lo:103: 00000100:00100000:0.0:1790918953.973902:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918953.974086:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550277760 00000100:00100000:2.0:1790918953.974092:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550277760 00010000:00010000:2.0:1790918953.974115:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88be813a2c00/0xc3296956897c3f65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c3f5e expref: 11 pid: 5839 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790918953.974150:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790918953.974157:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+11:3305:x1877914550277760:12345-0@lo:103: 00010000:00010000:2.0:1790918953.974186:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790918953.974192:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88be813a2c00/0xc3296956897c3f65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c3f5e expref: 11 pid: 5839 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918953.974214:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88be813a2c00/0xc3296956897c3f65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3296956897c3f5e expref: 11 pid: 5839 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918953.974239:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be813a2c00/0xc3296956897c3f65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3296956897c3f5e expref: 11 pid: 5839 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918953.974254:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88be81516600/0xc3296956897c404c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918953.974262:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be81516600/0xc3296956897c404c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918953.974276:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88be81516600/0xc3296956897c404c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918953.974409:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88be81516600/0xc3296956897c404c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918953.974415:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88be81516600/0xc3296956897c404c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918953.974421:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88be81516600/0xc3296956897c404c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918953.974426:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81516600 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:2.0:1790918953.974430:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88be81516600/0xc3296956897c404c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918953.974437:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88be81516600/0xc3296956897c404c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918953.974874:0:5840:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88be81516600/0xc3296956897c404c lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918953.974884:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88be81516600/0xc3296956897c404c lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790918953.974893:0:5840:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:2.0:1790918953.984416:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88be81516600/0xc3296956897c404c lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918953.984437:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be81516600/0xc3296956897c404c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918953.984456:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790918953.984722:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+10:3305:x1877914550277760:12345-0@lo:103: Request processed in 10562us (10815us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918953.984733:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790918953.984886:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be85f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550277760:0@lo:103: 00000100:00100000:2.0:1790918954.028990:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+9:6694:x1877914550276992:12345-0@lo:253: Request processed in 95038us (95362us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918954.029005:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790918954.029113:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88d99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:6694:1877914550276992:0@lo:253: 10000000:01000000:0.0:1790918954.029128:0:6694:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1790918954.029131:0:6694:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790918954.029134:0:6694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790918954.029135:0:6694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790918954.029136:0:6694:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1790918954.029138:0:6694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790918954.029140:0:6694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790918954.029141:0:6694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790918954.029143:0:6694:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1790918954.029145:0:6694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790918954.029146:0:6694:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790918954.029166:0:6694:0:(tgt_mount.c:101:server_register_mount()) register mount ffff88be86b70000 from lustre-OST0000 10000000:01000000:0.0:1790918954.029204:0:6694:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1790918954.029207:0:6694:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1790918954.029213:0:6694:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff88be88d33380 local copy 10000000:01000000:0.0:1790918954.029228:0:6694:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790918954.029260:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be80030600/0xc3296956897c4053 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918954.029271:0:6694:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.127@tcp lock: ffff88be80030600/0xc3296956897c4053 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918954.029280:0:6694:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88be80030600/0xc3296956897c4053 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790918954.029296:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88d99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:6694:1877914550277888:0@lo:101: 00000100:00100000:0.0:1790918954.029329:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918954.029437:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550277888 00000100:00100000:2.0:1790918954.029444:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550277888 00000100:00100000:2.0:1790918954.029483:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790918954.029492:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+9:6694:x1877914550277888:12345-0@lo:101: 00010000:00010000:2.0:1790918954.029506:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790918954.029519:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be813a2c00/0xc3296956897c405a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c4053 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918954.029571:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be813a2c00/0xc3296956897c405a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c4053 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918954.029582:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be813a2c00/0xc3296956897c405a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c4053 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918954.029592:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be813a2c00, rc 0) 00000100:00100000:2.0:1790918954.029626:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+10:6694:x1877914550277888:12345-0@lo:101: Request processed in 135us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918954.029632:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790918954.029720:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be86a73b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790918954.029733:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88d99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:6694:1877914550277888:0@lo:101: 00010000:00010000:0.0:1790918954.029744:0:6694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88be80030600/0xc3296956897c4053 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc3296956897c405a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918954.029754:0:6694:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88be80030600/0xc3296956897c4053 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc3296956897c405a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790918954.029963:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88d99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:6694:1877914550278016:0@lo:501: 00000100:00100000:0.0:1790918954.029989:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790918954.030053:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be86a73b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790918954.030260:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550278016 00000100:00100000:2.0:1790918954.030265:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550278016 00000100:00100000:2.0:1790918954.030337:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790918954.030345:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+10:6694:x1877914550278016:12345-0@lo:501: 00000100:00100000:2.0:1790918954.030568:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+10:6694:x1877914550278016:12345-0@lo:501: Request processed in 223us (577us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790918954.030575:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790918954.030735:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88d99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:6694:1877914550278016:0@lo:501: 10000000:01000000:0.0:1790918954.030750:0:6694:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.127@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1790918954.030792:0:6694:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.127@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1790918954.030804:0:6694:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be80030600/0xc3296956897c4053 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc3296956897c405a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918954.030813:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be80030600/0xc3296956897c4053 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc3296956897c405a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918954.030820:0:6694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.127@tcp lock: ffff88be80030600/0xc3296956897c4053 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc3296956897c405a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918954.030841:0:6694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1790918954.030860:0:6694:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff88be86b70000 10000000:01000000:0.0:1790918954.030865:0:6694:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1790918954.030870:0:6694:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff88be88d33380 10000000:01000000:0.0:1790918954.030872:0:6694:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1790918954.030875:0:6694:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff88be88d33380 from 1 10000000:01000000:0.0:1790918954.030878:0:6694:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1790918954.030898:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be80030800/0xc3296956897c4061 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918954.030907:0:6694:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88be80030800/0xc3296956897c4061 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918954.030916:0:6694:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88be80030800/0xc3296956897c4061 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790918954.030928:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88d99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:6694:1877914550278144:0@lo:101: 00000100:00100000:0.0:1790918954.030956:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790918954.032847:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be86a730c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790918954.032881:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550278144 00000100:00100000:0.0:1790918954.032889:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550278144 00000100:00100000:0.0:1790918954.032927:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790918954.032947:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+10:6694:x1877914550278144:12345-0@lo:101: 00010000:00010000:0.0:1790918954.033058:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790918954.033078:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be80031400/0xc3296956897c4068 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c4061 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918954.033105:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be80031400/0xc3296956897c4068 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c4061 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918954.033117:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be80031400/0xc3296956897c4068 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c4061 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918954.033126:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be80031400, rc 0) 00000100:00100000:0.0:1790918954.033177:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+11:6694:x1877914550278144:12345-0@lo:101: Request processed in 230us (2218us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918954.033184:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790918954.033247:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88d99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:6694:1877914550278144:0@lo:101: 00010000:00010000:0.0:1790918954.033263:0:6694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88be80030800/0xc3296956897c4061 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c4068 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918954.033274:0:6694:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88be80030800/0xc3296956897c4061 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c4068 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790918954.033294:0:6694:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1790918954.033314:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be80030800/0xc3296956897c4061 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c4068 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918954.033322:0:6694:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88be80030800/0xc3296956897c4061 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c4068 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790918954.033338:0:6694:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1790918954.033342:0:6694:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790918954.033347:0:6694:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1790918954.033349:0:6694:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1790918954.033381:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be80031000/0xc3296956897c406f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918954.033389:0:6694:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88be80031000/0xc3296956897c406f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918954.033397:0:6694:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88be80031000/0xc3296956897c406f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790918954.033413:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88d99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:6694:1877914550278272:0@lo:101: 00000100:00100000:0.0:1790918954.033442:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790918954.033457:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be86a730c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790918954.033470:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550278272 00000100:00100000:0.0:1790918954.033473:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550278272 00000100:00100000:0.0:1790918954.033491:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790918954.033496:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+11:6694:x1877914550278272:12345-0@lo:101: 00010000:00010000:0.0:1790918954.033502:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790918954.033509:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be80030200/0xc3296956897c4076 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c406f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918954.033522:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be80030200/0xc3296956897c4076 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c406f expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918954.033557:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be80030200/0xc3296956897c4076 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c406f expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918954.033569:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be80030200, rc 0) 00000100:00100000:0.0:1790918954.033597:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:6694:x1877914550278272:12345-0@lo:101: Request processed in 101us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918954.033603:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790918954.033633:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88d99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:6694:1877914550278272:0@lo:101: 00010000:00010000:0.0:1790918954.033642:0:6694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88be80031000/0xc3296956897c406f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c4076 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918954.033650:0:6694:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88be80031000/0xc3296956897c406f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c4076 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790918954.033735:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88d99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:6694:1877914550278400:0@lo:501: 00000100:00100000:0.0:1790918954.033759:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790918954.033879:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790918954.033886:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff88be80030600/0xc3296956897c4053 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc3296956897c405a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918954.033893:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be80030600 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:2.0:1790918954.033897:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff88be80030600/0xc3296956897c4053 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc3296956897c405a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918954.033905:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff88be80030600/0xc3296956897c4053 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xc3296956897c405a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790918954.033912:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff88be80030600/0xc3296956897c4053 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xc3296956897c405a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790918954.033918:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790918954.033937:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff88be80030600/0xc3296956897c4053 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc3296956897c405a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918954.033943:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790918954.033959:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff88be80030600/0xc3296956897c4053 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc3296956897c405a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918954.033984:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff88be80030600/0xc3296956897c4053 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc3296956897c405a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918954.033997:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790918954.033999:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790918954.034001:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790918954.034012:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be85f3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3307:1877914550278528:0@lo:103: 00000100:00100000:2.0:1790918954.034042:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918954.034230:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550278528 00000100:00100000:1.0:1790918954.034236:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550278528 00000100:00100000:1.0:1790918954.034270:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790918954.034278:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be85f38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:3307:x1877914550278528:12345-0@lo:103: 00010000:00010000:1.0:1790918954.034288:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790918954.034299:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be813a2c00/0xc3296956897c405a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3296956897c4053 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918954.034313:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790918954.034345:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be85f38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+11:3307:x1877914550278528:12345-0@lo:103: Request processed in 68us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918954.034351:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790918954.034381:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be85f3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3307:1877914550278528:0@lo:103: 00000100:00100000:0.0:1790918954.034437:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be86a730c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790918954.034485:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550278400 00000100:00100000:1.0:1790918954.034497:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550278400 00000100:00100000:1.0:1790918954.034560:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790918954.034569:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+11:6694:x1877914550278400:12345-0@lo:501: 00000100:00100000:1.0:1790918954.034792:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+11:6694:x1877914550278400:12345-0@lo:501: Request processed in 224us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918954.034799:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790918954.034831:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88d99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:6694:1877914550278400:0@lo:501: 00000100:00100000:1.0:1790918954.034858:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb35b3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:6694:1877914550278656:0@lo:503: 00000100:00100000:1.0:1790918954.034893:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918954.034912:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be88cb40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790918954.034924:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550278656 00000100:00100000:1.0:1790918954.034927:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550278656 00000100:00100000:1.0:1790918954.034944:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790918954.034950:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87167450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+11:6694:x1877914550278656:12345-0@lo:503: 00000100:00100000:1.0:1790918954.035274:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87167450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+11:6694:x1877914550278656:12345-0@lo:503: Request processed in 323us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918954.035281:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790918954.035836:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb35b3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:6694:1877914550278656:0@lo:503: 00000040:00080000:0.0:1790918954.036164:0:6694:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790918954.036257:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88d98a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:6694:1877914550278784:0@lo:502: 00000100:00100000:0.0:1790918954.036295:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790918954.036329:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be86a73780 going to sleep for 11 seconds 00000100:00100000:1.0:1790918954.036393:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550278784 00000100:00100000:1.0:1790918954.036398:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550278784 00000100:00100000:1.0:1790918954.036432:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790918954.036440:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+11:6694:x1877914550278784:12345-0@lo:502: 00000100:00100000:1.0:1790918954.036626:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+11:6694:x1877914550278784:12345-0@lo:502: Request processed in 187us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918954.036633:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790918954.036723:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88d98a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:6694:1877914550278784:0@lo:502: 00000040:00080000:2.0:1790918954.037113:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1790918954.037160:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1790918954.037194:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1790918954.037271:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1790918954.037309:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1790918954.037342:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1790918954.037368:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be85f38000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:6694:1877914550278912:0@lo:502: 00000100:00100000:2.0:1790918954.037407:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918954.037479:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb0b09300 going to sleep for 11 seconds 00000100:00100000:1.0:1790918954.037717:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550278912 00000100:00100000:1.0:1790918954.037722:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550278912 00000100:00100000:1.0:1790918954.037743:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790918954.037754:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87165c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+11:6694:x1877914550278912:12345-0@lo:502: 00000100:00100000:1.0:1790918954.038041:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87165c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+11:6694:x1877914550278912:12345-0@lo:502: Request processed in 286us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918954.038049:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790918954.038176:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be85f38000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:6694:1877914550278912:0@lo:502: 00000040:00080000:2.0:1790918954.038273:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1790918954.038282:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1790918954.038911:0:6713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790918954.038920:0:6713:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1790918954.038926:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790918954.038929:0:6713:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1790918954.038935:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790918954.038957:0:6713:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff88bebf8e0000) 00000020:00000080:1.0:1790918954.039046:0:6713:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1790918954.039053:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790918954.039111:0:6713:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88be86b70000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1790918954.039117:0:6713:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790918954.039123:0:6713:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc3296956897c4084 00010000:00010000:1.0:1790918954.047472:0:6713:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1790918954.048650:0:6713:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1790918954.051890:0:6713:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1790918954.052281:0:6713:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1790918954.063643:0:6713:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1790918954.064273:0:6713:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1790918954.067682:0:6713:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1790918954.067694:0:6713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790918954.067701:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790918954.067703:0:6713:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1790918954.067706:0:6713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790918954.067710:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790918954.067712:0:6713:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790918954.067722:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790918954.067724:0:6713:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1790918954.067794:0:6713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790918954.067798:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790918954.067799:0:6713:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1790918954.067802:0:6713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1790918954.068090:0:6694:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1790918954.068117:0:6694:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1790918954.068141:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be80031000/0xc3296956897c406f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c4076 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918954.068159:0:6694:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88be80031000/0xc3296956897c406f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c4076 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790918954.068168:0:6694:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88be86b70000 from 1 10000000:01000000:2.0:1790918954.068170:0:6694:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790918954.068209:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be813a3c00/0xc3296956897c408b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918954.068228:0:6694:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88be813a3c00/0xc3296956897c408b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918954.068240:0:6694:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88be813a3c00/0xc3296956897c408b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790918954.068263:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be85f38000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:6694:1877914550279040:0@lo:101: 00000100:00100000:2.0:1790918954.068328:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918954.068386:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb0b09f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790918954.068437:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550279040 00000100:00100000:0.0:1790918954.068445:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550279040 00000100:00100000:0.0:1790918954.068490:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790918954.068500:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+11:6694:x1877914550279040:12345-0@lo:101: 00010000:00010000:0.0:1790918954.068514:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790918954.068547:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be80030600/0xc3296956897c4092 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c408b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918954.068569:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be80030600/0xc3296956897c4092 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c408b expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918954.068579:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be80030600/0xc3296956897c4092 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c408b expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918954.068587:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be80030600, rc 0) 00000100:00100000:0.0:1790918954.068635:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:6694:x1877914550279040:12345-0@lo:101: Request processed in 136us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918954.068642:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790918954.068668:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be85f38000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:6694:1877914550279040:0@lo:101: 00010000:00010000:3.0:1790918954.068682:0:6694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88be813a3c00/0xc3296956897c408b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c4092 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918954.068691:0:6694:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88be813a3c00/0xc3296956897c408b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c4092 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790918954.068782:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:6694:1877914550279168:0@lo:501: 00000100:00100000:3.0:1790918954.068809:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918954.068841:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be8e1d53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790918954.069011:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550279168 00000100:00100000:0.0:1790918954.069016:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550279168 00000100:00100000:0.0:1790918954.069045:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790918954.069052:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87166c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:6694:x1877914550279168:12345-0@lo:501: 00000100:00100000:0.0:1790918954.069282:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87166c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:6694:x1877914550279168:12345-0@lo:501: Request processed in 230us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918954.069297:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790918954.069385:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:6694:1877914550279168:0@lo:501: 00000100:00100000:3.0:1790918954.069676:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:6694:1877914550279296:0@lo:503: 00000100:00100000:3.0:1790918954.069715:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918954.075595:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be8e1d53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790918954.076889:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550279296 00000100:00100000:2.0:1790918954.076903:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550279296 00000100:00100000:2.0:1790918954.077191:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790918954.077204:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:6694:x1877914550279296:12345-0@lo:503: 00000100:00100000:2.0:1790918954.077503:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:6694:x1877914550279296:12345-0@lo:503: Request processed in 302us (7787us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918954.084744:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790918954.084915:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:6694:1877914550279296:0@lo:503: 00000040:00080000:2.0:1790918954.085268:0:6694:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790918954.085337:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be85f39180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:6694:1877914550279424:0@lo:502: 00000100:00100000:2.0:1790918954.090103:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918954.090185:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb0b09240 going to sleep for 11 seconds 00000100:00100000:0.0:1790918954.092744:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550279424 00000100:00100000:0.0:1790918954.092755:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550279424 00000100:00100000:0.0:1790918954.092912:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790918954.092924:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:6694:x1877914550279424:12345-0@lo:502: 00000100:00100000:0.0:1790918954.093231:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:6694:x1877914550279424:12345-0@lo:502: Request processed in 308us (3130us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918954.093238:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790918954.093278:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be85f39180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:6694:1877914550279424:0@lo:502: 00000040:00080000:3.0:1790918954.094248:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1790918954.094309:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1790918954.094352:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:6694:1877914550279552:0@lo:502: 00000100:00100000:3.0:1790918954.094410:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918954.095096:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550279552 00000100:00100000:2.0:1790918954.095105:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550279552 00000100:00100000:2.0:1790918954.095157:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790918954.095166:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:6694:x1877914550279552:12345-0@lo:502: 00000100:00100000:2.0:1790918954.095390:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:6694:x1877914550279552:12345-0@lo:502: Request processed in 224us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918954.095397:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790918954.096581:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be8e1d53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790918954.096623:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:6694:1877914550279552:0@lo:502: 00000040:00080000:3.0:1790918954.096800:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1790918954.096815:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1790918954.097464:0:6717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790918954.097474:0:6717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790918954.097476:0:6717:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790918954.097482:0:6717:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88be86b70000 00000020:00000080:3.0:1790918954.097485:0:6717:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790918954.097503:0:6717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790918954.097505:0:6717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790918954.097506:0:6717:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1790918954.097509:0:6717:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1790918954.097894:0:6694:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1790918954.097915:0:6694:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790918954.097933:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be813a3c00/0xc3296956897c408b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c4092 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918954.097946:0:6694:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88be813a3c00/0xc3296956897c408b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c4092 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790918954.097998:0:6694:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1790918954.098001:0:6694:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff88be86b70000 10000000:01000000:2.0:1790918954.098004:0:6694:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff88be86b70000 10000000:01000000:2.0:1790918954.098008:0:6694:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790918954.098013:0:6694:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88be86b70000 from 1 10000000:01000000:2.0:1790918954.098016:0:6694:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790918954.098049:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be813a2800/0xc3296956897c4099 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918954.098057:0:6694:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88be813a2800/0xc3296956897c4099 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918954.098068:0:6694:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88be813a2800/0xc3296956897c4099 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790918954.098099:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be85f3a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:6694:1877914550279680:0@lo:101: 00000100:00100000:2.0:1790918954.098165:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918954.098203:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb0b099c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790918954.098391:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550279680 00000100:00100000:0.0:1790918954.098397:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550279680 00000100:00100000:0.0:1790918954.098441:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790918954.098450:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:6694:x1877914550279680:12345-0@lo:101: 00010000:00010000:0.0:1790918954.098463:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790918954.098489:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88bd81146600/0xc3296956897c40a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c4099 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918954.098513:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88bd81146600/0xc3296956897c40a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c4099 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918954.098623:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88bd81146600/0xc3296956897c40a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c4099 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918954.098633:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bd81146600, rc 0) 00000100:00100000:0.0:1790918954.098678:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:6694:x1877914550279680:12345-0@lo:101: Request processed in 229us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918954.098683:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790918954.098892:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be85f3a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:6694:1877914550279680:0@lo:101: 00010000:00010000:1.0:1790918954.098906:0:6694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88be813a2800/0xc3296956897c4099 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c40a0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918954.098915:0:6694:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88be813a2800/0xc3296956897c4099 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c40a0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790918954.099019:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb35b2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:6694:1877914550279808:0@lo:501: 00000100:00100000:1.0:1790918954.099042:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918954.099072:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be88cb4300 going to sleep for 11 seconds 00000100:00100000:2.0:1790918954.099175:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550279808 00000100:00100000:2.0:1790918954.099179:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550279808 00000100:00100000:2.0:1790918954.099207:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790918954.099222:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:6694:x1877914550279808:12345-0@lo:501: 00000100:00100000:2.0:1790918954.099434:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:6694:x1877914550279808:12345-0@lo:501: Request processed in 221us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918954.099440:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790918954.099556:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb35b2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:6694:1877914550279808:0@lo:501: 00000100:00100000:1.0:1790918954.099580:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb35b2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:6694:1877914550279936:0@lo:503: 00000100:00100000:1.0:1790918954.099614:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918954.099635:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be88cb4300 going to sleep for 11 seconds 00000100:00100000:1.0:1790918954.099649:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550279936 00000100:00100000:1.0:1790918954.099653:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550279936 00000100:00100000:1.0:1790918954.099669:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790918954.099675:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87166050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:6694:x1877914550279936:12345-0@lo:503: 00000100:00100000:1.0:1790918954.099817:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87166050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:6694:x1877914550279936:12345-0@lo:503: Request processed in 142us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918954.099823:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790918954.099862:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb35b2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:6694:1877914550279936:0@lo:503: 00000040:00080000:1.0:1790918954.100125:0:6694:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790918954.100179:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb35b2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:6694:1877914550280064:0@lo:502: 00000100:00100000:1.0:1790918954.100209:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918954.100236:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be88cb4300 going to sleep for 11 seconds 00000100:00100000:1.0:1790918954.100248:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550280064 00000100:00100000:1.0:1790918954.100251:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550280064 00000100:00100000:1.0:1790918954.100265:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790918954.100270:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87164c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:6694:x1877914550280064:12345-0@lo:502: 00000100:00100000:1.0:1790918954.100684:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87164c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:6694:x1877914550280064:12345-0@lo:502: Request processed in 412us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918954.100690:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790918954.100730:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb35b2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:6694:1877914550280064:0@lo:502: 00000040:00080000:1.0:1790918954.101082:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1790918954.101126:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1790918954.101169:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1790918954.101213:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1790918954.101261:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1790918954.101307:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1790918954.101343:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1790918954.103275:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1790918954.103387:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1790918954.103426:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1790918954.103460:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1790918954.103515:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1790918954.103598:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1790918954.103630:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1790918954.103675:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1790918954.103735:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1790918954.104155:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1790918954.104224:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1790918954.104267:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1790918954.104304:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1790918954.104370:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1790918954.104411:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1790918954.104445:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1790918954.104495:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1790918954.104906:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1790918954.104951:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1790918954.105086:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1790918954.105124:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1790918954.105179:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb35b2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:6694:1877914550280192:0@lo:502: 00000100:00100000:1.0:1790918954.105275:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918954.105386:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be88cb4300 going to sleep for 11 seconds 00000100:00100000:2.0:1790918954.105483:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550280192 00000100:00100000:2.0:1790918954.105491:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550280192 00000100:00100000:2.0:1790918954.105902:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790918954.105912:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87165050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:6694:x1877914550280192:12345-0@lo:502: 00000100:00100000:2.0:1790918954.106320:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87165050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:6694:x1877914550280192:12345-0@lo:502: Request processed in 409us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918954.106328:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790918954.106432:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb35b2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:6694:1877914550280192:0@lo:502: 00000040:00080000:1.0:1790918954.106552:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1790918954.106575:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1790918954.107326:0:6718:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1790918954.107342:0:6718:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff88bebf8e4d40) 00000020:00000080:1.0:1790918954.107361:0:6718:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1790918954.107455:0:6718:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88be86b70000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1790918954.107459:0:6718:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88be86b70000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1790918954.107462:0:6718:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88be86b70000 3 00010000:00080000:1.0:1790918954.107487:0:6718:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88bd8117f800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.127@tcp at head 00010000:00010000:1.0:1790918954.111665:0:6718:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1790918954.118208:0:6718:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1790918954.118257:0:6718:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790918954.118270:0:6718:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc3296956897c40ae 00000100:00080000:1.0:1790918954.118281:0:6718:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790918954.118292:0:6718:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff88bd8117f800 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:1.0:1790918954.118328:0:6718:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88beb35b2680 x1877914550280320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790918954.118363:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb35b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1877914550280320:0@lo:38: 00000100:00100000:1.0:1790918954.118912:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918954.119044:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550280320 00000100:00100000:1.0:1790918954.119051:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550280320 00000100:00100000:1.0:1790918954.119086:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790918954.119094:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1877914550280320:12345-0@lo:38: 00010000:00080000:1.0:1790918954.119116:0:5845:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 156 last 0 00000020:00000080:1.0:1790918954.119148:0:5845:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc3296956897c40b5 00000004:00100000:1.0:1790918954.119163:0:5845:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790918954.119193:0:5845:0:(import.c:65:import_set_state_nolock()) ffff88bd81179800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790918954.119253:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877914550280320:12345-0@lo:38: Request processed in 158us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918954.119271:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1790918954.119310:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff88beb35b2680 x1877914550280320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790918964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790918954.119321:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790918954.119329:0:3304:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1790918954.119336:0:3304:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1790918954.119340:0:3304:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790918954.119342:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88bd8117f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790918954.119348:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb35b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1877914550280320:0@lo:38: 00000100:00080000:1.0:1790918954.119852:0:6718:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000040:00080000:1.0:1790918954.126317:0:6718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:1.0:1790918954.128100:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790918954.128160:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790918954.128178:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be85f3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877914550280576:0@lo:400: 00000100:00100000:2.0:1790918954.128257:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1790918954.128660:0:6694:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1790918954.128689:0:6694:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790918954.128716:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be813a2800/0xc3296956897c4099 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c40a0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918954.128729:0:6694:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88be813a2800/0xc3296956897c4099 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c40a0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1790918954.128786:0:6694:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1790918954.128789:0:6694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790918954.128790:0:6694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790918954.128791:0:6694:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790918954.128792:0:6694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790918954.128794:0:6694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790918954.128796:0:6694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790918954.128797:0:6694:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790918954.128799:0:6694:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790918954.128804:0:6694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790918954.128806:0:6694:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790918954.128809:0:6694:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1790918954.128812:0:6694:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790918954.128813:0:6694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790918954.128814:0:6694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790918954.128815:0:6694:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790918954.128816:0:6694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790918954.128817:0:6694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790918954.128817:0:6694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790918954.128818:0:6694:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790918954.128819:0:6694:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790918954.128820:0:6694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790918954.128821:0:6694:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790918954.128838:0:6694:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1790918954.128847:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:6694:1877914550280704:0@lo:253: 00000100:00100000:3.0:1790918954.128885:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918954.129155:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be85f3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3307:1877914550280448:0@lo:400: 00000100:00100000:1.0:1790918954.129184:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918954.129285:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550280576 00000100:00100000:2.0:1790918954.129294:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550280576 00000100:00100000:2.0:1790918954.129332:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790918954.129341:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be85f38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877914550280576:12345-0@lo:400: 00000100:00100000:2.0:1790918954.129394:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be85f38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877914550280576:12345-0@lo:400: Request processed in 53us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918954.129411:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1790918954.129449:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff88be85f3bb80 x1877914550280576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790918970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790918954.129462:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be85f3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877914550280576:0@lo:400: 00000100:00100000:0.0:1790918954.129561:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550280704 00000100:00100000:0.0:1790918954.129566:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550280704 00000100:00100000:0.0:1790918954.129603:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550280448 00000100:00100000:0.0:1790918954.129606:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550280448 00000100:00100000:0.0:1790918954.129616:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790918954.129622:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87164450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+14:6694:x1877914550280704:12345-0@lo:253: 20000000:01000000:0.0:1790918954.129640:0:5840:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1790918954.129653:0:5840:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1790918954.130104:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790918954.130112:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+14:3307:x1877914550280448:12345-0@lo:400: 00000100:00100000:0.0:1790918954.130153:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+14:3307:x1877914550280448:12345-0@lo:400: Request processed in 42us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918954.130160:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790918954.130405:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be8e1d59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790918954.130504:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be85f3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3307:1877914550280448:0@lo:400: 20000000:01000000:1.0:1790918954.178303:0:5840:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790918954.178323:0:5840:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1790918954.178567:0:5861:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790918954.178573:0:5861:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790918954.178597:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88be813a3200/0xc3296956897c40bc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918954.178618:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88be81672c00/0xc3296956897c401b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c4014 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918954.178628:0:5861:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88be813a3200/0xc3296956897c40bc lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918954.178671:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88be81672c00/0xc3296956897c401b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3296956897c4014 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918954.178685:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88be81672c00/0xc3296956897c401b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3296956897c4014 expref: 13 pid: 5838 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790918954.178700:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be85f3bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1877914550280832:0@lo:104: 00000100:00100000:2.0:1790918954.178765:0:5861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918954.178892:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bebfb3d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790918954.178971:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550280832 00000100:00100000:3.0:1790918954.178980:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550280832 00000100:00100000:3.0:1790918954.179037:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790918954.179047:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be85f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+3:5861:x1877914550280832:12345-0@lo:104: 00010000:00010000:3.0:1790918954.179059:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.127@tcp lock: ffff88be80030000/0xc3296956897c4014 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c401b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918954.179121:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790918954.179127:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be85f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+3:5861:x1877914550280832:12345-0@lo:104: Request processed in 83us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918954.179135:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1790918954.179156:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790918954.179162:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff88be80030000/0xc3296956897c4014 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c401b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918954.179170:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be80030000 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:3.0:1790918954.179181:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff88be80030000/0xc3296956897c4014 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3296956897c401b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918954.179191:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff88be80030000/0xc3296956897c4014 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3296956897c401b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790918954.179198:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff88be80030000/0xc3296956897c4014 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3296956897c401b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790918954.179204:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790918954.179240:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff88be80030000/0xc3296956897c4014 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c401b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918954.179247:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790918954.179264:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff88be80030000/0xc3296956897c4014 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c401b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918954.179272:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff88be80030000/0xc3296956897c4014 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c401b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918954.179288:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790918954.179289:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790918954.179291:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790918954.179303:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3306:1877914550280960:0@lo:103: 00000100:00100000:3.0:1790918954.179336:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918954.179611:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be85f3bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1877914550280832:0@lo:104: 00010000:00010000:2.0:1790918954.179631:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88be813a3200/0xc3296956897c40bc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790918954.179952:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550280960 00000100:00100000:2.0:1790918954.179965:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550280960 00010000:00010000:2.0:1790918954.179985:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88be81672c00/0xc3296956897c401b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c4014 expref: 14 pid: 5838 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790918954.180016:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790918954.180023:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be91caec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+14:3306:x1877914550280960:12345-0@lo:103: 00010000:00010000:2.0:1790918954.180034:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790918954.180038:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88be81672c00/0xc3296956897c401b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c4014 expref: 14 pid: 5838 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918954.180049:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88be81672c00/0xc3296956897c401b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3296956897c4014 expref: 14 pid: 5838 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918954.180063:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be81672c00/0xc3296956897c401b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3296956897c4014 expref: 14 pid: 5838 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918954.180078:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88be813a3200/0xc3296956897c40bc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918954.180086:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be813a3200/0xc3296956897c40bc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790918954.180099:0:5829:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001527353s 00010000:00010000:2.0:1790918954.180105:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88be813a3200/0xc3296956897c40bc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918954.180113:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88be813a3200/0xc3296956897c40bc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918954.180121:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88be813a3200/0xc3296956897c40bc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918954.180139:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88be813a3200/0xc3296956897c40bc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918954.180145:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be813a3200 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:2.0:1790918954.180149:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88be813a3200/0xc3296956897c40bc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918954.180158:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88be813a3200/0xc3296956897c40bc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918954.180306:0:5861:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88be813a3200/0xc3296956897c40bc lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918954.180315:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88be813a3200/0xc3296956897c40bc lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918954.180357:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88be813a3200/0xc3296956897c40bc lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918954.180619:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be813a3200/0xc3296956897c40bc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918954.180636:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790918954.180727:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be91caec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:3306:x1877914550280960:12345-0@lo:103: Request processed in 704us (1389us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918954.180736:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790918954.180899:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3306:1877914550280960:0@lo:103: 00000100:00100000:1.0:1790918954.196197:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87164450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:6694:x1877914550280704:12345-0@lo:253: Request processed in 66565us (67301us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918954.196222:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790918954.196360:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:6694:1877914550280704:0@lo:253: 10000000:01000000:3.0:1790918954.196377:0:6694:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1790918954.196380:0:6694:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790918954.196382:0:6694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790918954.196383:0:6694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790918954.196384:0:6694:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790918954.196385:0:6694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790918954.196387:0:6694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790918954.196388:0:6694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790918954.196457:0:6694:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790918954.196460:0:6694:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790918954.196462:0:6694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790918954.196463:0:6694:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1790918954.196478:0:6694:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1790918954.203498:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1790918954.203691:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1790918954.204153:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1790918954.204317:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1790918954.204637:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1790918954.205038:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1790918954.206010:0:6694:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:2.0:1790918954.251616:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1790918954.432141:0:6694:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1790918954.432151:0:6694:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1790918954.432185:0:6694:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1790918954.432262:0:6694:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.127@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1790918954.432295:0:6694:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1790918954.432332:0:6694:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1790918955.268155:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790918956.297175:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790918957.314970:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790918958.335735:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790918959.367995:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790918959.380327:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790918959.380360:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb35b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1877914550281344:0@lo:400: 00000100:00100000:1.0:1790918959.380427:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918959.380559:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb35b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3307:1877914550281088:0@lo:400: 00000100:00100000:2.0:1790918959.380594:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918959.380616:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790918959.380621:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb35b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877914550281216:0@lo:400: 00000100:00100000:2.0:1790918959.380652:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918959.380677:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550281344 00000100:00100000:2.0:1790918959.380684:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550281344 00000100:00100000:2.0:1790918959.380728:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550281216 00000100:00100000:2.0:1790918959.380731:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550281216 00000100:00100000:2.0:1790918959.380746:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790918959.380753:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877914550281344:12345-0@lo:400: 00000100:00100000:2.0:1790918959.380798:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877914550281344:12345-0@lo:400: Request processed in 45us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918959.380804:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790918959.380817:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790918959.380823:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be85f3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877914550281216:12345-0@lo:400: 00000100:00100000:2.0:1790918959.380848:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be85f3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877914550281216:12345-0@lo:400: Request processed in 25us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918959.380853:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1790918959.380880:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88beb35b0000 x1877914550281216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790918975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790918959.380892:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb35b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877914550281216:0@lo:400: 00010000:00080000:2.0:1790918959.380921:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88beb35b1180 x1877914550281344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790918975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790918959.380929:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb35b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1877914550281344:0@lo:400: 00000100:00100000:0.0:1790918959.381189:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550281088 00000100:00100000:0.0:1790918959.381194:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550281088 00000100:00100000:0.0:1790918959.381227:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790918959.381235:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87167c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:3307:x1877914550281088:12345-0@lo:400: 00000100:00100000:0.0:1790918959.381275:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87167c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:3307:x1877914550281088:12345-0@lo:400: Request processed in 42us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918959.381282:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1790918959.381305:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790918959.381321:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb35b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3307:1877914550281088:0@lo:400: 00010000:00010000:3.0:1790918960.394179:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790918961.146250:0:7061:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg127-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1790918961.412696:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790918962.436324:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790918963.455677:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1790918963.455687:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88be91614800 from 21 10000000:01000000:0.0:1790918963.455695:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790918963.455763:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88bd81147600/0xc3296956897c40c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918963.455794:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88bd81147600/0xc3296956897c40c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918963.456211:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88bd81147600/0xc3296956897c40c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790918963.456245:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88d99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550281472:0@lo:101: 00000100:00100000:0.0:1790918963.456351:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790918963.456578:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be927eb840 going to sleep for 11 seconds 00010000:00010000:3.0:1790918963.456737:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790918963.456927:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550281472 00000100:00100000:2.0:1790918963.456936:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550281472 00000100:00100000:2.0:1790918963.457000:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790918963.457008:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be86bb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:5842:x1877914550281472:12345-0@lo:101: 00010000:00010000:2.0:1790918963.457033:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790918963.457051:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be813a3200/0xc3296956897c40ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c40c3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918963.457090:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be813a3200/0xc3296956897c40ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c40c3 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918963.457104:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be813a3200/0xc3296956897c40ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c40c3 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918963.457114:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be813a3200, rc 0) 00000100:00100000:2.0:1790918963.457159:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be86bb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:5842:x1877914550281472:12345-0@lo:101: Request processed in 152us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918963.457164:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790918963.457483:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88d99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550281472:0@lo:101: 00010000:00010000:0.0:1790918963.457502:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88bd81147600/0xc3296956897c40c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c40ca expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918963.457513:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88bd81147600/0xc3296956897c40c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c40ca expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790918963.457624:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88d99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550281600:0@lo:501: 00000100:00100000:0.0:1790918963.457651:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790918963.457672:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be927eb840 going to sleep for 11 seconds 00000100:00100000:2.0:1790918963.457861:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550281600 00000100:00100000:2.0:1790918963.457865:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550281600 00000100:00100000:2.0:1790918963.457922:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790918963.457928:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be86bbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:5842:x1877914550281600:12345-0@lo:501: 00000100:00100000:2.0:1790918963.458346:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be86bbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:5842:x1877914550281600:12345-0@lo:501: Request processed in 418us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918963.458352:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790918963.458407:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88d99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550281600:0@lo:501: 00000100:00100000:0.0:1790918963.458451:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88d99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550281728:0@lo:503: 00000100:00100000:0.0:1790918963.458487:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790918963.463886:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be927eb840 going to sleep for 11 seconds 00000100:00100000:3.0:1790918963.469124:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550281728 00000100:00100000:3.0:1790918963.469148:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550281728 00000100:00100000:2.0:1790918963.471248:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790918963.471266:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be86bb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:5842:x1877914550281728:12345-0@lo:503: 00000100:00100000:1.0:1790918963.482630:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88d99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550281728:0@lo:503: 00000100:00100000:1.0:1790918963.487117:0:7146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb35b3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7146:1877914550281856:0@lo:502: 00000100:00100000:1.0:1790918963.487235:0:7146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918963.487342:0:7146:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bebfb3da80 going to sleep for 11 seconds 00000100:00100000:2.0:1790918963.488578:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be86bb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:5842:x1877914550281728:12345-0@lo:503: Request processed in 17311us (30082us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918963.488593:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790918963.488665:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550281856 00000100:00100000:2.0:1790918963.488674:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550281856 00000100:00100000:3.0:1790918963.495180:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790918963.495215:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be86bba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:7146:x1877914550281856:12345-0@lo:502: 00000100:00100000:3.0:1790918963.498113:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be86bba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:7146:x1877914550281856:12345-0@lo:502: Request processed in 2902us (10865us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918963.498139:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790918963.498685:0:7146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb35b3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7146:1877914550281856:0@lo:502: 00000100:00100000:2.0:1790918963.498829:0:7146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be85f3a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7146:1877914550281984:0@lo:502: 00000100:00100000:2.0:1790918963.498915:0:7146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918963.498978:0:7146:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be86b02b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790918963.499582:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550281984 00000100:00100000:3.0:1790918963.499593:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550281984 00000100:00100000:3.0:1790918963.499663:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790918963.499674:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be86bb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:7146:x1877914550281984:12345-0@lo:502: 00000100:00100000:3.0:1790918963.500266:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be86bb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:7146:x1877914550281984:12345-0@lo:502: Request processed in 590us (1347us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918963.500276:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790918963.500938:0:7146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be85f3a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7146:1877914550281984:0@lo:502: 00000040:00080000:2.0:1790918963.500997:0:7146:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1790918963.501402:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1790918963.501489:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790918963.501505:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88bd81147600/0xc3296956897c40c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c40ca expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918963.501519:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88bd81147600/0xc3296956897c40c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c40ca expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790918963.501568:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790918963.501571:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88be91614800 from 4 10000000:01000000:3.0:1790918963.501575:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790918963.502130:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be81516c00/0xc3296956897c40d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918963.502145:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88be81516c00/0xc3296956897c40d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918963.502157:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88be81516c00/0xc3296956897c40d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790918963.502187:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550282112:0@lo:101: 00000100:00100000:3.0:1790918963.502364:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918963.502486:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb3b5c780 going to sleep for 11 seconds 00000100:00100000:1.0:1790918963.503155:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550282112 00000100:00100000:1.0:1790918963.503167:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550282112 00000100:00100000:1.0:1790918963.503274:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790918963.503286:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be86bb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:5842:x1877914550282112:12345-0@lo:101: 00010000:00010000:1.0:1790918963.503316:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790918963.503338:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be81673a00/0xc3296956897c40d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c40d1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918963.503370:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be81673a00/0xc3296956897c40d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c40d1 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918963.503383:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be81673a00/0xc3296956897c40d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c40d1 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918963.503394:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81673a00, rc 0) 00000100:00100000:1.0:1790918963.503490:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be86bb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+14:5842:x1877914550282112:12345-0@lo:101: Request processed in 206us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918963.503497:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790918963.503640:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550282112:0@lo:101: 00010000:00010000:2.0:1790918963.503662:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88be81516c00/0xc3296956897c40d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c40d8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918963.503673:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88be81516c00/0xc3296956897c40d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c40d8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790918963.503758:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be85f3a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550282240:0@lo:256: 00000100:00100000:2.0:1790918963.504232:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918963.509572:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be86b02b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790918963.512716:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550282240 00000100:00100000:1.0:1790918963.512738:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550282240 00000100:00100000:1.0:1790918963.512891:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790918963.512904:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be86bb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+14:5842:x1877914550282240:12345-0@lo:256: 20000000:01000000:1.0:1790918963.513127:0:5839:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790918963.513149:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790918963.513153:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1790918963.514715:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be86bb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+14:5842:x1877914550282240:12345-0@lo:256: Request processed in 1800us (10471us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918963.514733:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790918963.515121:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be85f3a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550282240:0@lo:256: 10000000:01000000:2.0:1790918963.515199:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790918963.515212:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be81516c00/0xc3296956897c40d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c40d8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918963.515226:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88be81516c00/0xc3296956897c40d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c40d8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790918963.515237:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1790918963.515240:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1790918963.515244:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1790918963.516140:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be813a3a00/0xc3296956897c40df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918963.516156:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88be813a3a00/0xc3296956897c40df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918963.516169:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88be813a3a00/0xc3296956897c40df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790918963.516196:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be85f3a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550282368:0@lo:101: 00000100:00100000:2.0:1790918963.516270:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918963.518643:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be86b02b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790918963.528602:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550282368 00000100:00100000:3.0:1790918963.528695:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550282368 00000100:00100000:2.0:1790918963.529394:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790918963.529896:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be86bb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+14:5842:x1877914550282368:12345-0@lo:101: 00010000:00010000:2.0:1790918963.529922:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790918963.531408:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be813a3000/0xc3296956897c40e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c40df expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918963.531783:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be813a3000/0xc3296956897c40e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c40df expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918963.532785:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be813a3000/0xc3296956897c40e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c40df expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918963.533597:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be813a3000, rc 0) 00000100:00100000:3.0:1790918963.534312:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be85f3a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550282368:0@lo:101: 00010000:00010000:3.0:1790918963.534347:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88be813a3a00/0xc3296956897c40df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c40e6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918963.534361:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88be813a3a00/0xc3296956897c40df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c40e6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790918963.534368:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be86bb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+15:5842:x1877914550282368:12345-0@lo:101: Request processed in 4958us (18093us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918963.534380:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790918963.534771:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550282496:0@lo:501: 00000100:00100000:3.0:1790918963.535153:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918963.535398:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb3b5c180 going to sleep for 11 seconds 00000100:00100000:2.0:1790918963.535457:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550282496 00000100:00100000:2.0:1790918963.535466:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550282496 00000100:00100000:2.0:1790918963.535565:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790918963.535576:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be86bbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+15:5842:x1877914550282496:12345-0@lo:501: 00000100:00100000:2.0:1790918963.537670:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be86bbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+15:5842:x1877914550282496:12345-0@lo:501: Request processed in 2084us (2506us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918963.537687:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790918963.541906:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550282496:0@lo:501: 00000100:00100000:3.0:1790918963.542428:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550282624:0@lo:503: 00000100:00100000:3.0:1790918963.542720:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918963.543305:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb3b5c180 going to sleep for 11 seconds 00000100:00100000:2.0:1790918963.547916:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550282624 00000100:00100000:2.0:1790918963.548109:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550282624 00000100:00100000:2.0:1790918963.548208:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790918963.548221:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be86bbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+15:5842:x1877914550282624:12345-0@lo:503: 00000100:00100000:2.0:1790918963.551803:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be86bbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+15:5842:x1877914550282624:12345-0@lo:503: Request processed in 3569us (9069us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918963.551823:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790918963.552183:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550282624:0@lo:503: 00000100:00100000:1.0:1790918963.555266:0:7151:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb35b3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7151:1877914550282752:0@lo:502: 00000100:00100000:1.0:1790918963.555400:0:7151:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918963.555472:0:7151:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be833129c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790918963.555563:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550282752 00000100:00100000:2.0:1790918963.555572:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550282752 00000100:00100000:2.0:1790918963.555776:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790918963.555789:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be86bba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+15:7151:x1877914550282752:12345-0@lo:502: 00000100:00100000:2.0:1790918963.556362:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be86bba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+15:7151:x1877914550282752:12345-0@lo:502: Request processed in 573us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918963.556372:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790918963.556479:0:7151:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb35b3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7151:1877914550282752:0@lo:502: 00000020:01000000:2.0:1790918963.556523:0:7151:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790918963.556557:0:7151:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1790918963.556567:0:7151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790918963.556570:0:7151:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1790918963.556578:0:7151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790918963.556582:0:7151:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.127@tcp to nid 0x20000c0a8c97f (192.168.201.127@tcp) 00000020:01000000:2.0:1790918963.556623:0:7151:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1790918963.556632:0:7151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790918963.556659:0:7151:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff88be88c74d40) 00000020:00000080:2.0:1790918963.556686:0:7151:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1790918963.556694:0:7151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790918963.556785:0:7151:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1790918963.556792:0:7151:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1790918963.556800:0:7151:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3296956897c40f4 00010000:00080000:2.0:1790918963.556839:0:7151:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88be88c8e000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.127@tcp at head 00010000:00010000:2.0:1790918963.557143:0:7151:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1790918963.643102:0:7151:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1790918963.643134:0:7151:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1790918963.644208:0:7151:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790918963.644421:0:7151:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790918963.644483:0:7151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1790918963.644668:0:7151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1790918963.645314:0:7162:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790918963.645321:0:7162:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1790918963.646118:0:7151:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790918963.646135:0:7151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1790918963.646177:0:7151:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1790918963.646206:0:7151:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3296956897c40fb 00000100:00080000:3.0:1790918963.646219:0:7151:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790918963.646234:0:7151:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff88be88c8e000 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:3.0:1790918963.646278:0:7151:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88be88db4e00 x1877914550282880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790918963.648741:0:7151:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1790918963.648949:0:7151:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790918963.648958:0:7151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790918963.648961:0:7151:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1790918963.648965:0:7151:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790918963.648971:0:7151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790918963.648972:0:7151:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790918963.648975:0:7151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790918963.648977:0:7151:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1790918963.649112:0:7151:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7151:1877914550283008:0@lo:502: 00000100:00100000:3.0:1790918963.649225:0:7151:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918963.649284:0:7151:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb3b5c840 going to sleep for 11 seconds 00000100:00100000:1.0:1790918963.649402:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1877914550282880:0@lo:8: 00000100:00100000:1.0:1790918963.649449:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918963.649722:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550282880 00000100:00100000:3.0:1790918963.649733:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550282880 00000100:00100000:3.0:1790918963.649775:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790918963.649784:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1877914550282880:12345-0@lo:8: 00010000:00080000:3.0:1790918963.649887:0:6698:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 165 last 0 00000020:00000080:3.0:1790918963.649922:0:6698:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3296956897c4102 00002000:00100000:3.0:1790918963.649969:0:6698:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff88bebf871000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1790918963.649975:0:6698:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1790918963.649980:0:6698:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1790918963.650217:0:6698:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1790918963.650388:0:6698:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790918963.650424:0:6698:0:(import.c:65:import_set_state_nolock()) ffff88bebf875000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790918963.650514:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1877914550282880:12345-0@lo:8: Request processed in 729us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918963.650555:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1790918963.650743:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88be88db4e00 x1877914550282880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790918973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790918963.650754:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790918963.650764:0:3304:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1790918963.650774:0:3304:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1790918963.650779:0:3304:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1790918963.650782:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88be88c8e000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790918963.650986:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88d9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877914550283136:0@lo:400: 00000004:00080000:1.0:1790918963.651116:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1790918963.651125:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1877914550282880:0@lo:8: 00000100:00100000:0.0:1790918963.651700:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790918963.651872:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88d99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1877914550283264:0@lo:400: 00000100:00100000:0.0:1790918963.651923:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790918963.651962:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550283136 00000100:00100000:0.0:1790918963.651969:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550283136 00000100:00100000:0.0:1790918963.652010:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550283264 00000100:00100000:0.0:1790918963.652013:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550283264 00000100:00100000:0.0:1790918963.652125:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790918963.652135:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88d9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877914550283136:12345-0@lo:400: 00000100:00100000:0.0:1790918963.652190:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88d9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877914550283136:12345-0@lo:400: Request processed in 56us (1152us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918963.652197:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790918963.652214:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790918963.652220:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88d9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877914550283264:12345-0@lo:400: 00000100:00100000:0.0:1790918963.652251:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88d9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877914550283264:12345-0@lo:400: Request processed in 31us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918963.652257:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1790918963.652281:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790918963.652309:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88be88d9b480 x1877914550283136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790918979 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790918963.652322:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88d9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877914550283136:0@lo:400: 00010000:00080000:0.0:1790918963.652348:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88be88d99500 x1877914550283264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790918979 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790918963.652357:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88d99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1877914550283264:0@lo:400: 00000100:00100000:2.0:1790918963.652959:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550283008 00000100:00100000:2.0:1790918963.652968:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550283008 00000100:00100000:2.0:1790918963.653016:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790918963.653025:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be86bb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+15:7151:x1877914550283008:12345-0@lo:502: 00000100:00100000:2.0:1790918963.653429:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be86bb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+15:7151:x1877914550283008:12345-0@lo:502: Request processed in 405us (4204us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918963.653437:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790918963.653522:0:7151:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7151:1877914550283008:0@lo:502: 00000020:01000000:2.0:1790918963.655479:0:7151:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790918963.655490:0:7151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790918963.655494:0:7151:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:2.0:1790918963.655505:0:7151:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000004:00080000:1.0:1790918963.656417:0:7162:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000020:01000000:3.0:1790918963.661091:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1790918963.661137:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1790918963.661154:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be813a3a00/0xc3296956897c40df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c40e6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918963.661169:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88be813a3a00/0xc3296956897c40df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c40e6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790918963.661182:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1790918963.661186:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff88be88d33380 from 1 10000000:01000000:3.0:1790918963.661189:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1790918963.661242:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be81517800/0xc3296956897c4109 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918963.661251:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88be81517800/0xc3296956897c4109 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918963.661265:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88be81517800/0xc3296956897c4109 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790918963.661296:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550283392:0@lo:101: 00000100:00100000:3.0:1790918963.661392:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918963.661460:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb3b5c480 going to sleep for 11 seconds 00000004:00080000:1.0:1790918963.663454:0:7162:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 165551924494ns, next at 0ns, rc = 0 00000100:00100000:2.0:1790918963.664674:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550283392 00000100:00100000:2.0:1790918963.664698:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550283392 00000100:00100000:2.0:1790918963.664779:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790918963.664792:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88d03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+15:5842:x1877914550283392:12345-0@lo:101: 00010000:00010000:2.0:1790918963.665138:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790918963.665162:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be813a2c00/0xc3296956897c4110 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c4109 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918963.665196:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be813a2c00/0xc3296956897c4110 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c4109 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918963.665209:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be813a2c00/0xc3296956897c4110 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c4109 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918963.665220:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be813a2c00, rc 0) 00000100:00100000:2.0:1790918963.665327:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88d03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+16:5842:x1877914550283392:12345-0@lo:101: Request processed in 538us (3934us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918963.665334:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790918963.665482:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550283392:0@lo:101: 00010000:00010000:3.0:1790918963.665505:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88be81517800/0xc3296956897c4109 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c4110 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918963.665516:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88be81517800/0xc3296956897c4109 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c4110 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790918963.665672:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550283520:0@lo:501: 00000100:00100000:3.0:1790918963.665715:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918963.665754:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb3b5c480 going to sleep for 11 seconds 00000100:00100000:2.0:1790918963.666200:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550283520 00000100:00100000:2.0:1790918963.666209:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550283520 00000100:00100000:2.0:1790918963.666258:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790918963.666268:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88d03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+16:5842:x1877914550283520:12345-0@lo:501: 00000100:00100000:2.0:1790918963.667149:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88d03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+16:5842:x1877914550283520:12345-0@lo:501: Request processed in 878us (1430us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790918963.667160:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790918963.667267:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550283520:0@lo:501: 10000000:01000000:3.0:1790918963.667313:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1790918963.667323:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be81517800/0xc3296956897c4109 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c4110 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918963.667334:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88be81517800/0xc3296956897c4109 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c4110 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790918963.737145:0:7163:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1790918963.737197:0:7163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be85f3bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7163:1877914550283776:0@lo:7: 00000100:00100000:2.0:1790918963.738139:0:7163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918963.738219:0:7163:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb0b09b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790918963.738253:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be85f38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550283648:0@lo:13: 00000100:00100000:2.0:1790918963.739139:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918963.739228:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550283776 00000100:00100000:2.0:1790918963.739239:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550283776 00000100:00100000:2.0:1790918963.739466:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790918963.739483:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be85f39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7163:x1877914550283776:12345-0@lo:7: 00000100:00100000:1.0:1790918963.740559:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550283648 00000100:00100000:1.0:1790918963.740571:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550283648 00000100:00100000:1.0:1790918963.740616:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790918963.740626:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be85f3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1877914550283648:12345-0@lo:13: 00002000:00000024:1.0:1790918963.740664:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1790918963.740772:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be85f3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1877914550283648:12345-0@lo:13: Request processed in 148us (1637us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918963.740780:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1790918963.743395:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88be85f38700 x1877914550283648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790918979 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790918963.743432:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be85f38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550283648:0@lo:13: 00002000:00080000:2.0:1790918963.758508:0:6700:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1790918963.758520:0:6700:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1790918963.758669:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be85f39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7163:x1877914550283776:12345-0@lo:7: Request processed in 19188us (21369us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918963.758683:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1790918963.758730:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790918963.758784:0:7163:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88be85f3bb80 x1877914550283776/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790918979 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790918963.759219:0:7163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be85f3bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7163:1877914550283776:0@lo:7: 00000004:00080000:2.0:1790918963.759241:0:7163:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1790918963.759350:0:7163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be85f3bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7163:1877914550283904:0@lo:5: 00000100:00100000:2.0:1790918963.759401:0:7163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918963.759454:0:7163:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be833126c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790918963.759481:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550283904 00000100:00100000:2.0:1790918963.759490:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550283904 00000100:00100000:2.0:1790918963.759585:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790918963.759596:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be85f3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7163:x1877914550283904:12345-0@lo:5: 00002000:00080000:2.0:1790918963.759630:0:6699:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1790918963.759636:0:6699:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1790918963.760149:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be85f3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7163:x1877914550283904:12345-0@lo:5: Request processed in 553us (746us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1790918963.760159:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1790918963.760246:0:7163:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88be85f3bb80 x1877914550283904/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790918979 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790918963.760259:0:7163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be85f3bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7163:1877914550283904:0@lo:5: 00000004:00080000:2.0:1790918963.760271:0:7163:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1790918963.761559:0:7163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be85f3a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7163:1877914550284032:0@lo:700: 00000100:00100000:2.0:1790918963.761632:0:7163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918963.761667:0:7163:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be833126c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790918963.761702:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550284032 00000100:00100000:2.0:1790918963.761710:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550284032 00000100:00100000:2.0:1790918963.761760:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790918963.761771:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be85f39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7163:x1877914550284032:12345-0@lo:700: 00000100:00100000:2.0:1790918963.762179:0:6706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be85f38000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6706:1877914550284160:0@lo:700: 00000100:00100000:2.0:1790918963.762215:0:6706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918963.762244:0:6706:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be833129c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790918963.762509:0:5852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550284160 00000100:00100000:3.0:1790918963.762516:0:5852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550284160 00000100:00100000:3.0:1790918963.762567:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790918963.762575:0:5852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be85f3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6706:x1877914550284160:12345-0@lo:700: 00000004:00080000:2.0:1790918963.792842:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:0.0:1790918963.828000:0:5852:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1790918963.836193:0:5852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be85f3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6706:x1877914550284160:12345-0@lo:700: Request processed in 73603us (73961us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918963.836221:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1790918963.836393:0:6706:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88be85f38000 x1877914550284160/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790918979 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790918963.836414:0:6706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be85f38000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6706:1877914550284160:0@lo:700: 40000000:02000000:2.0:1790918963.836432:0:6706:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:1.0:1790918963.990770:0:6722:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1790918963.990892:0:6722:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1790918963.991183:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be85f39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7163:x1877914550284032:12345-0@lo:700: Request processed in 229407us (229545us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918963.991225:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1790918963.991326:0:7163:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88be85f3a300 x1877914550284032/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790918979 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790918963.991340:0:7163:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1790918963.991360:0:7163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be85f3a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7163:1877914550284032:0@lo:700: 00000004:02000040:2.0:1790918964.027359:0:7163:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1790918964.031106:0:7163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88d99500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7163:1877914550284288:0@lo:5: 00000100:00100000:0.0:1790918964.031204:0:7163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790918964.031327:0:7163:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be927eb780 going to sleep for 11 seconds 00000100:00100000:2.0:1790918964.031422:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550284288 00000100:00100000:2.0:1790918964.031433:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550284288 00000100:00100000:2.0:1790918964.031510:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790918964.031523:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88d9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7163:x1877914550284288:12345-0@lo:5: 00002000:00080000:1.0:1790918964.041944:0:6698:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1790918964.041973:0:6698:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1790918964.050158:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88d9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7163:x1877914550284288:12345-0@lo:5: Request processed in 18627us (18942us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1790918964.050207:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1790918964.050753:0:7163:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88be88d99500 x1877914550284288/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790918980 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790918964.050777:0:7163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88d99500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7163:1877914550284288:0@lo:5: 00000004:00080000:0.0:1790918964.050862:0:7163:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:3.0:1790918964.484869:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790918965.513154:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790918966.528727:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790918967.476144:0:6722:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1790918967.562477:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790918968.579620:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790918969.088410:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88d98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550284416:0@lo:13: 00000100:00100000:0.0:1790918969.088516:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790918969.088692:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550284416 00000100:00100000:0.0:1790918969.088702:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550284416 00000100:00100000:0.0:1790918969.088769:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790918969.088778:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88d98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550284416:12345-0@lo:13: 00002000:00000024:0.0:1790918969.088881:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790918969.088930:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88d98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550284416:12345-0@lo:13: Request processed in 152us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918969.088937:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1790918969.089283:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790918969.089303:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88d9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877914550284672:0@lo:400: 00000100:00100000:0.0:1790918969.089339:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790918969.089361:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790918969.089366:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88d9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1877914550284800:0@lo:400: 00000100:00100000:0.0:1790918969.089384:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790918969.089409:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550284672 00000100:00100000:0.0:1790918969.089426:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550284672 00000100:00100000:0.0:1790918969.089465:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550284800 00000100:00100000:0.0:1790918969.089468:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550284800 00000100:00100000:0.0:1790918969.089485:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790918969.089490:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88d9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877914550284672:12345-0@lo:400: 00000100:00100000:0.0:1790918969.089557:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88d9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877914550284672:12345-0@lo:400: Request processed in 66us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918969.089563:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790918969.089575:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790918969.089580:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88d98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877914550284800:12345-0@lo:400: 00000100:00100000:0.0:1790918969.089604:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88d98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877914550284800:12345-0@lo:400: Request processed in 24us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918969.089609:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790918969.089631:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88d99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3306:1877914550284544:0@lo:400: 00000100:00100000:0.0:1790918969.089659:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790918969.089696:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550284544 00000100:00100000:0.0:1790918969.089699:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550284544 00000100:00100000:0.0:1790918969.089725:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790918969.089730:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88d02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+16:3306:x1877914550284544:12345-0@lo:400: 00000100:00100000:0.0:1790918969.089757:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88d02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+16:3306:x1877914550284544:12345-0@lo:400: Request processed in 27us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918969.089762:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:1.0:1790918969.092905:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88be88d9b100 x1877914550284800/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790918985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790918969.092932:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88d9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1877914550284800:0@lo:400: 00010000:00080000:1.0:1790918969.092950:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88be88d9a300 x1877914550284672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790918985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790918969.092970:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88d9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877914550284672:0@lo:400: 00010000:00080000:1.0:1790918969.093040:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88be88d98700 x1877914550284416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790918985 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790918969.093091:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1790918969.093117:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88d98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550284416:0@lo:13: 00000100:00080000:0.0:1790918969.093363:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790918969.093772:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88d99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3306:1877914550284544:0@lo:400: 00010000:00010000:3.0:1790918969.601549:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790918970.623786:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790918971.651868:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790918972.671926:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790918973.714207:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790918974.210619:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88d9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3306:1877914550285056:0@lo:400: 00000100:00100000:0.0:1790918974.210707:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918974.210744:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88d99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550284928:0@lo:13: 00000100:00100000:1.0:1790918974.210776:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790918974.210780:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88d98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1877914550285312:0@lo:400: 00000100:00100000:1.0:1790918974.210796:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88d99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550285440:0@lo:400: 00000100:00100000:0.0:1790918974.210806:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918974.210814:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790918974.210823:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790918974.210828:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88d99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877914550285184:0@lo:400: 00000100:00100000:1.0:1790918974.210843:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550284928 00000100:00100000:0.0:1790918974.210847:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918974.210850:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550284928 00000100:00100000:0.0:1790918974.210881:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550285056 00000100:00100000:0.0:1790918974.210885:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550285056 00000100:00100000:1.0:1790918974.210910:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790918974.210910:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790918974.210918:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550284928:12345-0@lo:13: 00000100:00100000:0.0:1790918974.210918:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88d01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+16:3306:x1877914550285056:12345-0@lo:400: 00002000:00000024:1.0:1790918974.210949:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790918974.210966:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88d01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+16:3306:x1877914550285056:12345-0@lo:400: Request processed in 49us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918974.210973:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790918974.210978:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550284928:12345-0@lo:13: Request processed in 62us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918974.210995:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790918974.211005:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550285312 00000100:00100000:0.0:1790918974.211008:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550285312 00000100:00100000:1.0:1790918974.211012:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550285440 00000100:00100000:1.0:1790918974.211014:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550285440 00000100:00100000:0.0:1790918974.211030:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550285184 00000100:00100000:1.0:1790918974.211032:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790918974.211033:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550285184 00000100:00100000:1.0:1790918974.211038:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550285440:12345-0@lo:400: 00000100:00100000:0.0:1790918974.211044:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790918974.211049:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88d9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877914550285312:12345-0@lo:400: 00000100:00100000:1.0:1790918974.211067:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550285440:12345-0@lo:400: Request processed in 29us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918974.211073:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790918974.211077:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88d9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877914550285312:12345-0@lo:400: Request processed in 27us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918974.211082:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1790918974.211087:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790918974.211091:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790918974.211092:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790918974.211097:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88d9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877914550285184:12345-0@lo:400: 00000100:00100000:0.0:1790918974.211123:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88d9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877914550285184:12345-0@lo:400: Request processed in 25us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918974.211128:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1790918974.211168:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88be88d99c00 x1877914550285184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790918990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790918974.211190:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88d99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877914550285184:0@lo:400: 00010000:00080000:0.0:1790918974.211202:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88be88d98700 x1877914550285312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790918990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790918974.211209:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88d98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1877914550285312:0@lo:400: 00000100:00100000:0.0:1790918974.211233:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88d9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3306:1877914550285056:0@lo:400: 00010000:00080000:1.0:1790918974.211268:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88be88d99180 x1877914550284928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790918990 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790918974.211289:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88d99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550284928:0@lo:13: 00010000:00080000:1.0:1790918974.211301:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88be88d99500 x1877914550285440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790918990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790918974.211308:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88d99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550285440:0@lo:400: 00010000:00010000:1.0:1790918974.721582:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1790918974.813314:0:7644:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1790918974.813318:0:7644:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1790918974.813585:0:7644:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff88bebf8da800 00000020:01000004:1.0:1790918974.813715:0:7644:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1790918974.813729:0:7644:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1790918974.813743:0:7644:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff88bebf8e3380) 00000020:00000080:1.0:1790918974.813759:0:7644:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1790918974.830328:0:7644:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1790918974.831380:0:7644:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1790918974.893310:0:7644:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1790918974.902954:0:7644:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1790918974.903122:0:7644:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1790918974.903177:0:7644:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1790918974.903209:0:7644:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1790918974.903792:0:7644:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1790918974.903804:0:7644:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790918974.903814:0:7644:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc3296956897c411e 00000020:01000004:3.0:1790918974.903822:0:7644:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1790918974.903845:0:7644:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.127@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1790918974.903848:0:7644:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.127@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1790918974.903865:0:7644:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1790918974.903887:0:7644:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1790918974.903891:0:7644:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.127@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1790918974.951282:0:7644:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.127@tcp ctxt 0 is initialized 00000020:01000004:0.0:1790918974.951325:0:7644:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.127@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1790918974.951329:0:7644:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1790918974.951330:0:7644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790918974.951332:0:7644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790918974.951333:0:7644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790918974.951334:0:7644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790918974.951335:0:7644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790918974.951336:0:7644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790918974.951338:0:7644:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790918974.951339:0:7644:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790918974.951341:0:7644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790918974.951343:0:7644:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790918974.951347:0:7644:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1790918974.951349:0:7644:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790918974.951350:0:7644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790918974.951351:0:7644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790918974.951352:0:7644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790918974.951353:0:7644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790918974.951354:0:7644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790918974.951355:0:7644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790918974.951356:0:7644:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790918974.951357:0:7644:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790918974.951358:0:7644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790918974.951359:0:7644:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790918974.951388:0:7644:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1790918974.951416:0:7644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88d9aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7644:1877914550285568:0@lo:253: 00000100:00100000:0.0:1790918974.951496:0:7644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790918974.951576:0:7644:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be86a73000 going to sleep for 11 seconds 00000100:00100000:1.0:1790918974.951998:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550285568 00000100:00100000:1.0:1790918974.952006:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550285568 00000100:00100000:1.0:1790918974.952057:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790918974.952067:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+16:7644:x1877914550285568:12345-0@lo:253: 20000000:01000000:1.0:1790918974.952097:0:5838:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1790918974.952102:0:5838:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1790918974.952107:0:5838:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1790918974.952110:0:5838:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1790918974.953280:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790918974.955082:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1790918974.955107:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1790918974.955164:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1790918974.955172:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1790918974.955201:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1790918974.955247:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1790918974.959571:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1790918974.959613:0:5838:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.127@tcp 20000000:01000000:1.0:1790918974.959616:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.127@tcp (null) (null) (null) 00000040:00080000:1.0:1790918974.959700:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1790918974.959709:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1790918974.959765:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1790918974.959774:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.127@tcp (null) (null) 00000040:00080000:1.0:1790918974.959804:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1790918974.959813:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1790918974.959838:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1790918974.959908:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1790918974.962217:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1790918974.962245:0:5838:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.127@tcp 20000000:01000000:1.0:1790918974.962247:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.127@tcp (null) (null) (null) 00000040:00080000:1.0:1790918974.962282:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1790918974.962291:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1790918974.962319:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1790918974.962327:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.127@tcp (null) (null) 00000040:00080000:1.0:1790918974.962357:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1790918974.962365:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1790918974.962424:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1790918974.962463:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1790918974.962479:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1790918974.962481:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1790918974.962487:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1790918974.962489:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1790918974.962492:0:5838:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1790918974.962504:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1790918974.962507:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1790918974.962826:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1790918974.962829:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1790918974.964226:0:7646:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1790918974.964298:0:7646:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1790918974.964325:0:7646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1790918974.964931:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1790918974.964996:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1790918974.965043:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1790918974.965055:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1790918974.965058:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1790918974.965873:0:7647:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1790918974.965946:0:7647:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1790918974.966075:0:7647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1790918974.971300:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1790918974.971355:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1790918974.971445:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1790918974.971461:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1790918974.971464:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1790918974.975920:0:7648:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1790918974.976283:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1790918974.976321:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1790918974.976382:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1790918974.976399:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1790918974.976402:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1790918974.978176:0:7649:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1790918974.978262:0:7649:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1790918974.978340:0:7649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1790918974.978764:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1790918974.978811:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1790918974.978848:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 10000000:01000000:1.0:1790918974.978877:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1790918974.978897:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88be81673600/0xc3296956897c4125 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918974.978916:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88be80030200/0xc3296956897c4076 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c406f expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918974.978924:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88bd81146600/0xc3296956897c40a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c4099 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918974.978932:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88be813a3200/0xc3296956897c40ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c40c3 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918974.978939:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88be813a3000/0xc3296956897c40e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c40df expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918974.978945:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88be813a2c00/0xc3296956897c4110 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c4109 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918974.978953:0:5838:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88be81673600/0xc3296956897c4125 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918974.978988:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88be813a2c00/0xc3296956897c4110 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3296956897c4109 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918974.979007:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88be813a2c00/0xc3296956897c4110 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3296956897c4109 expref: 16 pid: 5840 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790918974.979022:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb35b3b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5838:1877914550285696:0@lo:104: 00000100:00100000:1.0:1790918974.979083:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790918974.979133:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88be813a3000/0xc3296956897c40e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3296956897c40df expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918974.979142:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88be813a3000/0xc3296956897c40e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3296956897c40df expref: 16 pid: 5838 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790918974.979150:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb35b3100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5838:1877914550285824:0@lo:104: 00010000:00010000:1.0:1790918974.979168:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88be813a3200/0xc3296956897c40ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3296956897c40c3 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918974.979176:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88be813a3200/0xc3296956897c40ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3296956897c40c3 expref: 16 pid: 5840 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790918974.979183:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb35b2680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5838:1877914550285952:0@lo:104: 00010000:00010000:1.0:1790918974.979197:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88bd81146600/0xc3296956897c40a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3296956897c4099 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918974.979204:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88bd81146600/0xc3296956897c40a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3296956897c4099 expref: 16 pid: 5839 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790918974.979212:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb35b1180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5838:1877914550286080:0@lo:104: 00010000:00010000:1.0:1790918974.979227:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88be80030200/0xc3296956897c4076 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3296956897c406f expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918974.979244:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88be80030200/0xc3296956897c4076 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3296956897c406f expref: 16 pid: 5840 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790918974.979252:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb35b0000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5838:1877914550286208:0@lo:104: 00000100:00100000:1.0:1790918974.979266:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beadae59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790918974.980044:0:5827:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1790918974.980068:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918974.980093:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918974.980102:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918974.980109:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918974.980119:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550285696 00000100:00100000:2.0:1790918974.980126:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550285696 00000100:00100000:2.0:1790918974.980159:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550285824 00000100:00100000:2.0:1790918974.980162:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550285824 00000100:00100000:2.0:1790918974.980172:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550285952 00000100:00100000:2.0:1790918974.980174:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550285952 00000100:00100000:2.0:1790918974.980182:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550286080 00000100:00100000:2.0:1790918974.980184:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550286080 00000100:00100000:2.0:1790918974.980193:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550286208 00000100:00100000:2.0:1790918974.980194:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550286208 00000100:00100000:2.0:1790918974.980206:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790918974.980214:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be8e0c7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+7:5838:x1877914550285696:12345-0@lo:104: 00010000:00010000:2.0:1790918974.980228:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.127@tcp lock: ffff88be81517800/0xc3296956897c4109 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c4110 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918974.980291:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790918974.980296:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be8e0c7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+7:5838:x1877914550285696:12345-0@lo:104: Request processed in 84us (1214us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918974.980303:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790918974.980340:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790918974.980346:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be85f3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+6:5838:x1877914550285824:12345-0@lo:104: 00010000:00010000:2.0:1790918974.980354:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.127@tcp lock: ffff88be813a3a00/0xc3296956897c40df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c40e6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918974.980878:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790918974.980886:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be85f3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+6:5838:x1877914550285824:12345-0@lo:104: Request processed in 539us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918974.980893:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790918974.980910:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790918974.980917:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be85f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+5:5838:x1877914550285952:12345-0@lo:104: 00010000:00010000:2.0:1790918974.980925:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.127@tcp lock: ffff88bd81147600/0xc3296956897c40c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c40ca expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918974.980957:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1790918974.980962:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be85f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+5:5838:x1877914550285952:12345-0@lo:104: Request processed in 47us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918974.980968:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790918974.980979:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790918974.980984:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be85f38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+4:5838:x1877914550286080:12345-0@lo:104: 00010000:00010000:2.0:1790918974.980991:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.127@tcp lock: ffff88be813a2800/0xc3296956897c4099 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c40a0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918974.981025:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1790918974.981030:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be85f38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+4:5838:x1877914550286080:12345-0@lo:104: Request processed in 46us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918974.981036:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790918974.981048:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790918974.981054:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be85f39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+3:5838:x1877914550286208:12345-0@lo:104: 00010000:00010000:2.0:1790918974.981062:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.127@tcp lock: ffff88be80031000/0xc3296956897c406f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c4076 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918974.981086:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1790918974.981090:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be85f39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+3:5838:x1877914550286208:12345-0@lo:104: Request processed in 37us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918974.981095:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1790918974.981116:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1790918974.981122:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff88be81517800/0xc3296956897c4109 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c4110 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918974.981129:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81517800 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:2.0:1790918974.981132:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff88be81517800/0xc3296956897c4109 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3296956897c4110 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918974.981140:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff88be81517800/0xc3296956897c4109 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3296956897c4110 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790918974.981147:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff88be81517800/0xc3296956897c4109 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3296956897c4110 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790918974.981152:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790918974.981198:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff88be81517800/0xc3296956897c4109 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c4110 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918974.981205:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790918974.981223:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff88be81517800/0xc3296956897c4109 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c4110 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918974.981229:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff88be81517800/0xc3296956897c4109 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c4110 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918974.981242:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1790918974.981245:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff88be813a3a00/0xc3296956897c40df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c40e6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918974.981250:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be813a3a00 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:2.0:1790918974.981252:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff88be813a3a00/0xc3296956897c40df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3296956897c40e6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918974.981258:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff88be813a3a00/0xc3296956897c40df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3296956897c40e6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790918974.981264:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff88be813a3a00/0xc3296956897c40df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3296956897c40e6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790918974.981269:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790918974.981281:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff88be813a3a00/0xc3296956897c40df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c40e6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918974.981286:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790918974.981299:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff88be813a3a00/0xc3296956897c40df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c40e6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918974.981316:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff88be813a3a00/0xc3296956897c40df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c40e6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918974.981329:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790918974.981332:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff88bd81147600/0xc3296956897c40c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c40ca expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918974.981337:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bd81147600 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:2.0:1790918974.981340:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff88bd81147600/0xc3296956897c40c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3296956897c40ca expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918974.981346:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff88bd81147600/0xc3296956897c40c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3296956897c40ca expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790918974.981353:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff88bd81147600/0xc3296956897c40c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3296956897c40ca expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790918974.981357:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790918974.981370:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff88bd81147600/0xc3296956897c40c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c40ca expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918974.981375:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790918974.982198:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1790918974.982218:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790918974.982235:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be85f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550286336:0@lo:103: 00000100:00100000:1.0:1790918974.982289:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918974.982331:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be85f3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3307:1877914550286464:0@lo:103: 00000100:00100000:1.0:1790918974.982348:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918974.982363:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790918974.982367:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be85f3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3307:1877914550286592:0@lo:103: 00000100:00100000:1.0:1790918974.982380:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918974.982404:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550286336 00000100:00100000:1.0:1790918974.982422:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550286336 00010000:00010000:1.0:1790918974.982448:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88be813a2c00/0xc3296956897c4110 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c4109 expref: 17 pid: 5840 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790918974.982465:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550286464 00000100:00100000:1.0:1790918974.982468:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550286464 00010000:00010000:1.0:1790918974.982477:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88be813a3000/0xc3296956897c40e6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c40df expref: 18 pid: 5838 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790918974.982487:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550286592 00000100:00100000:1.0:1790918974.982489:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550286592 00010000:00010000:1.0:1790918974.982498:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88be813a3200/0xc3296956897c40ca lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c40c3 expref: 19 pid: 5840 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790918974.982524:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790918974.982548:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3305:x1877914550286336:12345-0@lo:103: 00010000:00010000:1.0:1790918974.982560:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790918974.982565:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88be813a2c00/0xc3296956897c4110 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c4109 expref: 19 pid: 5840 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918974.982576:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88be813a2c00/0xc3296956897c4110 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3296956897c4109 expref: 19 pid: 5840 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918974.982592:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790918974.982623:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3305:x1877914550286336:12345-0@lo:103: Request processed in 76us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918974.982629:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790918974.982713:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790918974.982720:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:3307:x1877914550286464:12345-0@lo:103: 00010000:00010000:1.0:1790918974.982727:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790918974.982731:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88be813a3000/0xc3296956897c40e6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c40df expref: 18 pid: 5838 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918974.982740:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88be813a3000/0xc3296956897c40e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3296956897c40df expref: 18 pid: 5838 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918974.982748:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790918974.982772:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:3307:x1877914550286464:12345-0@lo:103: Request processed in 53us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918974.982778:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790918974.982788:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790918974.982799:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:3307:x1877914550286592:12345-0@lo:103: 00010000:00010000:1.0:1790918974.982806:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790918974.982810:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88be813a3200/0xc3296956897c40ca lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c40c3 expref: 17 pid: 5840 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918974.982819:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88be813a3200/0xc3296956897c40ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3296956897c40c3 expref: 17 pid: 5840 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918974.982828:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790918974.982845:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:3307:x1877914550286592:12345-0@lo:103: Request processed in 46us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918974.982850:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790918974.982899:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be85f3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3307:1877914550286592:0@lo:103: 00000100:00100000:1.0:1790918974.982907:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be85f3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3307:1877914550286464:0@lo:103: 00000100:00100000:1.0:1790918974.982926:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be85f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550286336:0@lo:103: 00010000:00010000:1.0:1790918974.983048:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be813a2c00/0xc3296956897c4110 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3296956897c4109 expref: 16 pid: 5840 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790918974.983061:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb35b3b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5838:1877914550285696:0@lo:104: 00010000:00010000:1.0:1790918974.983070:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be813a3000/0xc3296956897c40e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3296956897c40df expref: 15 pid: 5838 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790918974.983079:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb35b3100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5838:1877914550285824:0@lo:104: 00010000:00010000:1.0:1790918974.983087:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be813a3200/0xc3296956897c40ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3296956897c40c3 expref: 14 pid: 5840 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790918974.983094:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb35b2680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5838:1877914550285952:0@lo:104: 00000100:00100000:1.0:1790918974.983108:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb35b1180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5838:1877914550286080:0@lo:104: 00000100:00100000:1.0:1790918974.983114:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb35b0000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5838:1877914550286208:0@lo:104: 00010000:00010000:1.0:1790918974.983134:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88be81673600/0xc3296956897c4125 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918974.983651:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff88bd81147600/0xc3296956897c40c3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c40ca expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918974.983663:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff88bd81147600/0xc3296956897c40c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c40ca expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918974.983676:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790918974.983686:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff88be80031000/0xc3296956897c406f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c4076 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918974.983693:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be80031000 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:2.0:1790918974.983697:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff88be80031000/0xc3296956897c406f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3296956897c4076 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918974.983705:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff88be80031000/0xc3296956897c406f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3296956897c4076 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790918974.983712:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff88be80031000/0xc3296956897c406f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3296956897c4076 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790918974.983718:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790918974.983741:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff88be80031000/0xc3296956897c406f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c4076 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918974.983747:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790918974.983766:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff88be80031000/0xc3296956897c406f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c4076 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918974.983773:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff88be80031000/0xc3296956897c406f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c4076 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790918974.983780:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be85f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550286720:0@lo:103: 00010000:00010000:2.0:1790918974.983783:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790918974.983785:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790918974.983787:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790918974.983812:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918974.983877:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550286720 00000100:00100000:2.0:1790918974.983883:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550286720 00010000:00010000:2.0:1790918974.983902:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88be80030200/0xc3296956897c4076 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c406f expref: 14 pid: 5840 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790918974.983938:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790918974.983945:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+14:3305:x1877914550286720:12345-0@lo:103: 00010000:00010000:2.0:1790918974.983953:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790918974.983957:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88be80030200/0xc3296956897c4076 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c406f expref: 14 pid: 5840 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918974.983965:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88be80030200/0xc3296956897c4076 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3296956897c406f expref: 14 pid: 5840 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918974.983976:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be80030200/0xc3296956897c4076 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3296956897c406f expref: 14 pid: 5840 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918974.983988:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790918974.984015:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:3305:x1877914550286720:12345-0@lo:103: Request processed in 72us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918974.984021:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790918974.984776:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be85f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550286720:0@lo:103: 00010000:00010000:0.0:1790918974.987592:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790918974.987598:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790918974.987600:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790918974.987621:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff88be813a2800/0xc3296956897c4099 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c40a0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918974.987633:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be813a2800 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:1.0:1790918974.987646:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff88be813a2800/0xc3296956897c4099 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3296956897c40a0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918974.987658:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff88be813a2800/0xc3296956897c4099 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3296956897c40a0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790918974.987665:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff88be813a2800/0xc3296956897c4099 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3296956897c40a0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790918974.987671:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790918974.987719:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff88be813a2800/0xc3296956897c4099 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c40a0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918974.987726:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790918974.987756:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff88be813a2800/0xc3296956897c4099 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c40a0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918974.987781:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff88be813a2800/0xc3296956897c4099 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c40a0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790918974.987786:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb35b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3306:1877914550286848:0@lo:103: 00010000:00010000:1.0:1790918974.987800:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790918974.987802:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790918974.987804:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790918974.987867:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918974.988641:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550286848 00000100:00100000:1.0:1790918974.988651:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550286848 00010000:00010000:1.0:1790918974.988682:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88bd81146600/0xc3296956897c40a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c4099 expref: 13 pid: 5839 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790918974.988716:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790918974.988725:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be85f38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:3306:x1877914550286848:12345-0@lo:103: 00010000:00010000:1.0:1790918974.988739:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790918974.988744:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88bd81146600/0xc3296956897c40a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c4099 expref: 13 pid: 5839 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918974.988756:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88bd81146600/0xc3296956897c40a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3296956897c4099 expref: 13 pid: 5839 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918974.988772:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88bd81146600/0xc3296956897c40a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3296956897c4099 expref: 13 pid: 5839 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918974.988786:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88be81673600/0xc3296956897c4125 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918974.988793:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be81673600/0xc3296956897c4125 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918974.988822:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88be81673600/0xc3296956897c4125 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918974.988829:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88be81673600/0xc3296956897c4125 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918974.988836:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88be81673600/0xc3296956897c4125 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918974.988843:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88be81673600/0xc3296956897c4125 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918974.988849:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81673600 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:1.0:1790918974.988864:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88be81673600/0xc3296956897c4125 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918974.988872:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88be81673600/0xc3296956897c4125 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918974.988894:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88be81673600/0xc3296956897c4125 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918974.988905:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790918974.988962:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be85f38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:3306:x1877914550286848:12345-0@lo:103: Request processed in 238us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918974.988970:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1790918974.989105:0:5838:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88be81673600/0xc3296956897c4125 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918974.989115:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88be81673600/0xc3296956897c4125 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918974.989122:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be81673600/0xc3296956897c4125 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790918974.989137:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1790918974.989274:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb35b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3306:1877914550286848:0@lo:103: 00000100:00100000:1.0:1790918975.049223:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+11:7644:x1877914550285568:12345-0@lo:253: Request processed in 97146us (97716us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918975.049238:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790918975.049353:0:7644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88d9aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7644:1877914550285568:0@lo:253: 10000000:01000000:3.0:1790918975.049368:0:7644:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1790918975.049371:0:7644:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790918975.049373:0:7644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790918975.049375:0:7644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790918975.049376:0:7644:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1790918975.049377:0:7644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790918975.049379:0:7644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790918975.049394:0:7644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790918975.049396:0:7644:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1790918975.049398:0:7644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790918975.049399:0:7644:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1790918975.049430:0:7644:0:(tgt_mount.c:101:server_register_mount()) register mount ffff88bebf8da800 from lustre-OST0001 10000000:01000000:3.0:1790918975.049455:0:7644:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1790918975.049458:0:7644:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1790918975.049465:0:7644:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff88be88d33380 local copy 10000000:01000000:3.0:1790918975.049469:0:7644:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1790918975.049506:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be81517000/0xc3296956897c412c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918975.049517:0:7644:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.127@tcp lock: ffff88be81517000/0xc3296956897c412c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918975.049558:0:7644:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88be81517000/0xc3296956897c412c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790918975.049578:0:7644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7644:1877914550286976:0@lo:101: 00000100:00100000:3.0:1790918975.049623:0:7644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918975.049818:0:7644:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb3f480c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790918975.049883:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550286976 00000100:00100000:1.0:1790918975.049900:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550286976 00000100:00100000:1.0:1790918975.049946:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790918975.049955:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+11:7644:x1877914550286976:12345-0@lo:101: 00010000:00010000:1.0:1790918975.049980:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790918975.049995:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be81673600/0xc3296956897c4133 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c412c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918975.050019:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be81673600/0xc3296956897c4133 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c412c expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918975.050030:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be81673600/0xc3296956897c4133 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c412c expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918975.050038:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81673600, rc 0) 00000100:00100000:1.0:1790918975.050070:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:7644:x1877914550286976:12345-0@lo:101: Request processed in 116us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918975.050076:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790918975.050219:0:7644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7644:1877914550286976:0@lo:101: 00010000:00010000:3.0:1790918975.050232:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88be81517000/0xc3296956897c412c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc3296956897c4133 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918975.050242:0:7644:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88be81517000/0xc3296956897c412c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc3296956897c4133 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790918975.050367:0:7644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7644:1877914550287104:0@lo:501: 00000100:00100000:3.0:1790918975.050394:0:7644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918975.050419:0:7644:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb3f480c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790918975.050947:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550287104 00000100:00100000:1.0:1790918975.050953:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550287104 00000100:00100000:1.0:1790918975.051002:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790918975.051010:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:7644:x1877914550287104:12345-0@lo:501: 00000100:00100000:1.0:1790918975.051224:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:7644:x1877914550287104:12345-0@lo:501: Request processed in 215us (828us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790918975.051231:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790918975.051386:0:7644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7644:1877914550287104:0@lo:501: 10000000:01000000:3.0:1790918975.051402:0:7644:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.127@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1790918975.051438:0:7644:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.127@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1790918975.051444:0:7644:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be81517000/0xc3296956897c412c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc3296956897c4133 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918975.051453:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be81517000/0xc3296956897c412c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc3296956897c4133 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918975.051459:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.127@tcp lock: ffff88be81517000/0xc3296956897c412c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc3296956897c4133 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918975.051483:0:7644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1790918975.051503:0:7644:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff88bebf8da800 10000000:01000000:3.0:1790918975.051507:0:7644:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790918975.051513:0:7644:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1790918975.051516:0:7644:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790918975.051520:0:7644:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1790918975.051523:0:7644:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1790918975.051571:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be81517a00/0xc3296956897c413a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918975.051580:0:7644:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88be81517a00/0xc3296956897c413a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918975.051588:0:7644:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88be81517a00/0xc3296956897c413a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790918975.051612:0:7644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7644:1877914550287232:0@lo:101: 00000100:00100000:3.0:1790918975.051651:0:7644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918975.051683:0:7644:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb3f48780 going to sleep for 11 seconds 00000100:00100000:3.0:1790918975.051697:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550287232 00000100:00100000:3.0:1790918975.051701:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550287232 00000100:00100000:3.0:1790918975.051723:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790918975.051729:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:7644:x1877914550287232:12345-0@lo:101: 00010000:00010000:3.0:1790918975.051737:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790918975.051747:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be81516e00/0xc3296956897c4141 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c413a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918975.051765:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be81516e00/0xc3296956897c4141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c413a expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918975.051775:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be81516e00/0xc3296956897c4141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c413a expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918975.051783:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81516e00, rc 0) 00000100:00100000:3.0:1790918975.051809:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:7644:x1877914550287232:12345-0@lo:101: Request processed in 80us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918975.051815:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790918975.051842:0:7644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7644:1877914550287232:0@lo:101: 00010000:00010000:3.0:1790918975.051866:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88be81517a00/0xc3296956897c413a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c4141 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918975.051874:0:7644:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88be81517a00/0xc3296956897c413a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c4141 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790918975.051925:0:7644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7644:1877914550287360:0@lo:501: 00000100:00100000:3.0:1790918975.051947:0:7644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918975.051958:0:7644:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb3f48780 going to sleep for 11 seconds 00000100:00100000:3.0:1790918975.051991:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550287360 00000100:00100000:3.0:1790918975.051995:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550287360 00000100:00100000:3.0:1790918975.052015:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790918975.052021:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:7644:x1877914550287360:12345-0@lo:501: 00000100:00100000:3.0:1790918975.052184:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:7644:x1877914550287360:12345-0@lo:501: Request processed in 162us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918975.052190:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790918975.052219:0:7644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7644:1877914550287360:0@lo:501: 00000100:00100000:3.0:1790918975.052242:0:7644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7644:1877914550287488:0@lo:503: 00000100:00100000:3.0:1790918975.052279:0:7644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918975.052293:0:7644:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb3f48780 going to sleep for 11 seconds 00000100:00100000:3.0:1790918975.052304:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550287488 00000100:00100000:3.0:1790918975.052307:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550287488 00000100:00100000:3.0:1790918975.052326:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790918975.052332:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:7644:x1877914550287488:12345-0@lo:503: 00000100:00100000:3.0:1790918975.052464:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:7644:x1877914550287488:12345-0@lo:503: Request processed in 132us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918975.052470:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790918975.052509:0:7644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7644:1877914550287488:0@lo:503: 00000040:00080000:3.0:1790918975.052784:0:7644:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790918975.052837:0:7644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7644:1877914550287616:0@lo:502: 00000100:00100000:3.0:1790918975.052883:0:7644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918975.052905:0:7644:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb3f48780 going to sleep for 11 seconds 00000100:00100000:3.0:1790918975.052918:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550287616 00000100:00100000:3.0:1790918975.052921:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550287616 00000100:00100000:3.0:1790918975.052954:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790918975.052960:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:7644:x1877914550287616:12345-0@lo:502: 00000100:00100000:3.0:1790918975.053099:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:7644:x1877914550287616:12345-0@lo:502: Request processed in 138us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918975.053106:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790918975.053145:0:7644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7644:1877914550287616:0@lo:502: 00000040:00080000:3.0:1790918975.053377:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1790918975.053422:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1790918975.053458:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1790918975.053506:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1790918975.053576:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1790918975.053612:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1790918975.053637:0:7644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7644:1877914550287744:0@lo:502: 00000100:00100000:3.0:1790918975.053672:0:7644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918975.053693:0:7644:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb3f48780 going to sleep for 11 seconds 00000100:00100000:3.0:1790918975.053707:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550287744 00000100:00100000:3.0:1790918975.053710:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550287744 00000100:00100000:3.0:1790918975.053733:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790918975.053739:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:7644:x1877914550287744:12345-0@lo:502: 00000100:00100000:3.0:1790918975.053869:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:7644:x1877914550287744:12345-0@lo:502: Request processed in 129us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918975.053876:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790918975.053914:0:7644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7644:1877914550287744:0@lo:502: 00000040:00080000:3.0:1790918975.053983:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1790918975.053993:0:7644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00010000:00010000:1.0:1790918975.054732:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790918975.054742:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff88be81517000/0xc3296956897c412c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc3296956897c4133 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918975.054753:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81517000 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:1.0:1790918975.054769:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff88be81517000/0xc3296956897c412c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc3296956897c4133 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918975.054778:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff88be81517000/0xc3296956897c412c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xc3296956897c4133 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790918975.054786:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff88be81517000/0xc3296956897c412c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xc3296956897c4133 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790918975.054792:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790918975.054819:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff88be81517000/0xc3296956897c412c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc3296956897c4133 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918975.054825:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790918975.054845:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff88be81517000/0xc3296956897c412c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc3296956897c4133 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918975.054865:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff88be81517000/0xc3296956897c412c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc3296956897c4133 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918975.054878:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790918975.054880:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790918975.054882:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790918975.054894:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb35b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3307:1877914550287872:0@lo:103: 00000100:00100000:1.0:1790918975.054936:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918975.054999:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550287872 00000100:00100000:1.0:1790918975.055004:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550287872 00000100:00100000:1.0:1790918975.055036:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790918975.055044:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:3307:x1877914550287872:12345-0@lo:103: 00010000:00010000:1.0:1790918975.055055:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790918975.055075:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be81673600/0xc3296956897c4133 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3296956897c412c expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918975.055088:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790918975.055120:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:3307:x1877914550287872:12345-0@lo:103: Request processed in 78us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918975.055127:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790918975.055158:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb35b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3307:1877914550287872:0@lo:103: 00000020:01000000:1.0:1790918975.056036:0:7652:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790918975.056045:0:7652:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1790918975.056052:0:7652:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790918975.056055:0:7652:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1790918975.056062:0:7652:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790918975.056080:0:7652:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff88bebf8e19c0) 00000020:00000080:1.0:1790918975.056101:0:7652:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1790918975.056106:0:7652:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790918975.056162:0:7652:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88bebf8da800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1790918975.056170:0:7652:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790918975.056175:0:7652:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc3296956897c414f 00010000:00010000:0.0:1790918975.060842:0:7652:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1790918975.061231:0:7652:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1790918975.064107:0:7652:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1790918975.064398:0:7652:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1790918975.070557:0:7652:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1790918975.071298:0:7652:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1790918975.073518:0:7652:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1790918975.073556:0:7652:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790918975.073564:0:7652:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790918975.073566:0:7652:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1790918975.073577:0:7652:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790918975.073581:0:7652:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790918975.073583:0:7652:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790918975.073586:0:7652:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790918975.073588:0:7652:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1790918975.073820:0:7652:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790918975.073825:0:7652:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790918975.073826:0:7652:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:3.0:1790918975.073830:0:7652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1790918975.076929:0:7644:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1790918975.076975:0:7644:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1790918975.076997:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be81517a00/0xc3296956897c413a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c4141 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918975.077018:0:7644:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88be81517a00/0xc3296956897c413a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c4141 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790918975.077027:0:7644:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88bebf8da800 from 1 10000000:01000000:0.0:1790918975.077030:0:7644:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790918975.077083:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88bd81147200/0xc3296956897c4156 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918975.077095:0:7644:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88bd81147200/0xc3296956897c4156 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918975.077107:0:7644:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88bd81147200/0xc3296956897c4156 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790918975.077130:0:7644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88d98700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7644:1877914550288000:0@lo:101: 00000100:00100000:0.0:1790918975.077201:0:7644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790918975.077243:0:7644:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be86a733c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790918975.077460:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550288000 00000100:00100000:1.0:1790918975.077468:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550288000 00000100:00100000:1.0:1790918975.077522:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790918975.077563:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:7644:x1877914550288000:12345-0@lo:101: 00010000:00010000:1.0:1790918975.077577:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790918975.077589:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be81673600/0xc3296956897c415d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c4156 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918975.077624:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be81673600/0xc3296956897c415d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c4156 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918975.077635:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be81673600/0xc3296956897c415d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c4156 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918975.077826:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81673600, rc 0) 00000100:00100000:1.0:1790918975.077895:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:7644:x1877914550288000:12345-0@lo:101: Request processed in 334us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918975.077903:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790918975.077995:0:7644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88d98700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7644:1877914550288000:0@lo:101: 00010000:00010000:2.0:1790918975.078021:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88bd81147200/0xc3296956897c4156 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c415d expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918975.078031:0:7644:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88bd81147200/0xc3296956897c4156 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c415d expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790918975.078129:0:7644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be85f38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7644:1877914550288128:0@lo:501: 00000100:00100000:2.0:1790918975.078166:0:7644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918975.078189:0:7644:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be82d60f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790918975.078321:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550288128 00000100:00100000:1.0:1790918975.078325:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550288128 00000100:00100000:1.0:1790918975.078353:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790918975.078360:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:7644:x1877914550288128:12345-0@lo:501: 00000100:00100000:1.0:1790918975.078605:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:7644:x1877914550288128:12345-0@lo:501: Request processed in 234us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918975.078613:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790918975.078871:0:7644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be85f38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7644:1877914550288128:0@lo:501: 00000100:00100000:2.0:1790918975.078906:0:7644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be85f38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7644:1877914550288256:0@lo:503: 00000100:00100000:2.0:1790918975.078947:0:7644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918975.078983:0:7644:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be82d60f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790918975.079115:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550288256 00000100:00100000:1.0:1790918975.079120:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550288256 00000100:00100000:1.0:1790918975.079150:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1790918975.079157:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:7644:x1877914550288256:12345-0@lo:503: 00000100:00100000:1.0:1790918975.079499:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:7644:x1877914550288256:12345-0@lo:503: Request processed in 341us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918975.079506:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1790918975.086160:0:7644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be85f38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7644:1877914550288256:0@lo:503: 00000040:00080000:0.0:1790918975.086470:0:7644:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790918975.086819:0:7644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88d99c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7644:1877914550288384:0@lo:502: 00000100:00100000:0.0:1790918975.086905:0:7644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790918975.087174:0:7644:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be86a73000 going to sleep for 11 seconds 00000100:00100000:3.0:1790918975.088894:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550288384 00000100:00100000:3.0:1790918975.088905:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550288384 00000100:00100000:3.0:1790918975.088998:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790918975.089114:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:7644:x1877914550288384:12345-0@lo:502: 00000100:00100000:3.0:1790918975.089414:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:7644:x1877914550288384:12345-0@lo:502: Request processed in 398us (2499us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918975.089422:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1790918975.089512:0:7644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88d99c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7644:1877914550288384:0@lo:502: 00000040:00080000:0.0:1790918975.089872:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1790918975.089931:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1790918975.089980:0:7644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88d99c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7644:1877914550288512:0@lo:502: 00000100:00100000:0.0:1790918975.090037:0:7644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790918975.090576:0:7644:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be86a73000 going to sleep for 11 seconds 00000100:00100000:1.0:1790918975.090786:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550288512 00000100:00100000:1.0:1790918975.090793:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550288512 00000100:00100000:1.0:1790918975.090829:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1790918975.090837:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:7644:x1877914550288512:12345-0@lo:502: 00000100:00100000:1.0:1790918975.091181:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:7644:x1877914550288512:12345-0@lo:502: Request processed in 344us (1143us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918975.091190:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1790918975.091317:0:7644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88d99c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7644:1877914550288512:0@lo:502: 00000040:00080000:0.0:1790918975.091509:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1790918975.091773:0:7644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1790918975.092910:0:7656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790918975.092932:0:7656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790918975.092935:0:7656:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790918975.092942:0:7656:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88bebf8da800 00000020:00000080:1.0:1790918975.092945:0:7656:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790918975.093109:0:7656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790918975.093113:0:7656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790918975.093114:0:7656:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1790918975.093118:0:7656:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1790918975.093274:0:7644:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1790918975.093302:0:7644:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790918975.093360:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88bd81147200/0xc3296956897c4156 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c415d expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918975.093374:0:7644:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88bd81147200/0xc3296956897c4156 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c415d expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790918975.093427:0:7644:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790918975.093430:0:7644:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff88bebf8da800 10000000:01000000:3.0:1790918975.093433:0:7644:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff88bebf8da800 10000000:01000000:3.0:1790918975.093437:0:7644:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790918975.093443:0:7644:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88bebf8da800 from 1 10000000:01000000:3.0:1790918975.093446:0:7644:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790918975.093483:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be81517600/0xc3296956897c4164 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918975.093497:0:7644:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88be81517600/0xc3296956897c4164 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918975.093509:0:7644:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88be81517600/0xc3296956897c4164 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790918975.093560:0:7644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7644:1877914550288640:0@lo:101: 00000100:00100000:3.0:1790918975.093904:0:7644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918975.093942:0:7644:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb3f48f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790918975.093993:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550288640 00000100:00100000:1.0:1790918975.093999:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550288640 00000100:00100000:1.0:1790918975.094049:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1790918975.094059:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:7644:x1877914550288640:12345-0@lo:101: 00010000:00010000:1.0:1790918975.094072:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790918975.094085:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be81672400/0xc3296956897c416b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c4164 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918975.094107:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be81672400/0xc3296956897c416b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c4164 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918975.094117:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be81672400/0xc3296956897c416b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c4164 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918975.094125:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81672400, rc 0) 00000100:00100000:1.0:1790918975.094174:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+14:7644:x1877914550288640:12345-0@lo:101: Request processed in 116us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918975.094181:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1790918975.094312:0:7644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7644:1877914550288640:0@lo:101: 00010000:00010000:0.0:1790918975.094326:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88be81517600/0xc3296956897c4164 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c416b expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918975.094343:0:7644:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88be81517600/0xc3296956897c4164 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c416b expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790918975.094441:0:7644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88d99c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7644:1877914550288768:0@lo:501: 00000100:00100000:0.0:1790918975.094468:0:7644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790918975.094493:0:7644:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be86a73000 going to sleep for 11 seconds 00000100:00100000:3.0:1790918975.094632:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550288768 00000100:00100000:3.0:1790918975.094637:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550288768 00000100:00100000:3.0:1790918975.094676:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1790918975.094684:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+14:7644:x1877914550288768:12345-0@lo:501: 00000100:00100000:3.0:1790918975.094923:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+14:7644:x1877914550288768:12345-0@lo:501: Request processed in 240us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918975.094929:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1790918975.094959:0:7644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88d99c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7644:1877914550288768:0@lo:501: 00000100:00100000:3.0:1790918975.094984:0:7644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7644:1877914550288896:0@lo:503: 00000100:00100000:3.0:1790918975.095028:0:7644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918975.095047:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550288896 00000100:00100000:3.0:1790918975.095051:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550288896 00000100:00100000:3.0:1790918975.095067:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1790918975.095072:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+14:7644:x1877914550288896:12345-0@lo:503: 00000100:00100000:3.0:1790918975.095198:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+14:7644:x1877914550288896:12345-0@lo:503: Request processed in 125us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918975.095205:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1790918975.095238:0:7644:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb3f48900 going to sleep for 11 seconds 00000100:00100000:3.0:1790918975.095250:0:7644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7644:1877914550288896:0@lo:503: 00000040:00080000:3.0:1790918975.095501:0:7644:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790918975.095576:0:7644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7644:1877914550289024:0@lo:502: 00000100:00100000:3.0:1790918975.095610:0:7644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918975.095632:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550289024 00000100:00100000:3.0:1790918975.095636:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550289024 00000100:00100000:3.0:1790918975.095657:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1790918975.095662:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+14:7644:x1877914550289024:12345-0@lo:502: 00000100:00100000:3.0:1790918975.095797:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+14:7644:x1877914550289024:12345-0@lo:502: Request processed in 134us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918975.095803:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1790918975.095831:0:7644:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb3f48900 going to sleep for 11 seconds 00000100:00100000:3.0:1790918975.095843:0:7644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7644:1877914550289024:0@lo:502: 00000040:00080000:3.0:1790918975.096093:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1790918975.096138:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1790918975.096183:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1790918975.096225:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1790918975.096257:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1790918975.096299:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1790918975.096334:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1790918975.096367:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1790918975.096414:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1790918975.096449:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1790918975.096484:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1790918975.096560:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1790918975.096598:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1790918975.096631:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1790918975.096689:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1790918975.096734:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1790918975.096768:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1790918975.096819:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1790918975.096883:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1790918975.096918:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1790918975.096969:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1790918975.097007:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1790918975.097042:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1790918975.097099:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1790918975.097138:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1790918975.097168:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1790918975.097210:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1790918975.097245:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1790918975.097276:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1790918975.097320:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1790918975.097353:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1790918975.097386:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1790918975.097418:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1790918975.097464:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1790918975.097516:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1790918975.097593:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1790918975.097626:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1790918975.097661:0:7644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7644:1877914550289152:0@lo:502: 00000100:00100000:3.0:1790918975.097722:0:7644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918975.097765:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550289152 00000100:00100000:3.0:1790918975.097771:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550289152 00000100:00100000:3.0:1790918975.097800:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1790918975.097806:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+14:7644:x1877914550289152:12345-0@lo:502: 00000100:00100000:3.0:1790918975.099184:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+14:7644:x1877914550289152:12345-0@lo:502: Request processed in 1371us (1456us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918975.099196:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1790918975.099261:0:7644:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb3f48900 going to sleep for 11 seconds 00000100:00100000:3.0:1790918975.099285:0:7644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7644:1877914550289152:0@lo:502: 00000040:00080000:3.0:1790918975.099379:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1790918975.099392:0:7644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1790918975.100399:0:7657:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1790918975.100428:0:7657:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff88bebaa30000) 00000020:00000080:1.0:1790918975.100452:0:7657:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1790918975.101194:0:7657:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88bebf8da800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1790918975.101201:0:7657:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88bebf8da800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1790918975.101211:0:7657:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88bebf8da800 3 00010000:00080000:1.0:1790918975.101245:0:7657:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88beb3f1c800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.127@tcp at head 00010000:00010000:1.0:1790918975.103507:0:7657:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1790918975.104170:0:7657:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1790918975.104209:0:7657:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790918975.104220:0:7657:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc3296956897c4179 00000100:00080000:1.0:1790918975.104230:0:7657:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790918975.104242:0:7657:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88beb3f1c800 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:1.0:1790918975.104279:0:7657:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88beb35b2680 x1877914550289280/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790918975.104310:0:7657:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1790918975.104486:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb35b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1877914550289280:0@lo:38: 00000100:00100000:2.0:1790918975.104578:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918975.104785:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550289280 00000100:00100000:1.0:1790918975.104793:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550289280 00000100:00100000:1.0:1790918975.104821:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790918975.104828:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be85f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3304:x1877914550289280:12345-0@lo:38: 00010000:00080000:1.0:1790918975.104859:0:5846:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 176 last 0 00000020:00000080:1.0:1790918975.104887:0:5846:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc3296956897c4180 00000004:00100000:1.0:1790918975.104901:0:5846:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790918975.104928:0:5846:0:(import.c:65:import_set_state_nolock()) ffff88bebf8d8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790918975.104984:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be85f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877914550289280:12345-0@lo:38: Request processed in 155us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918975.104991:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1790918975.105166:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88beb35b2680 x1877914550289280/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790918985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790918975.105177:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790918975.105184:0:3304:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1790918975.105190:0:3304:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1790918975.105194:0:3304:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790918975.105196:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88beb3f1c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790918975.105202:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb35b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1877914550289280:0@lo:38: 00000040:00080000:3.0:1790918975.108579:0:7657:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1790918975.108702:0:7644:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1790918975.108726:0:7644:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790918975.108742:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be81517600/0xc3296956897c4164 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c416b expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918975.108753:0:7644:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88be81517600/0xc3296956897c4164 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c416b expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1790918975.108800:0:7644:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1790918975.108802:0:7644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790918975.108804:0:7644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790918975.108805:0:7644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790918975.108806:0:7644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790918975.108807:0:7644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790918975.108809:0:7644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790918975.108810:0:7644:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790918975.108812:0:7644:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790918975.108813:0:7644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790918975.108815:0:7644:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790918975.108818:0:7644:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1790918975.108821:0:7644:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790918975.108822:0:7644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790918975.108823:0:7644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790918975.108824:0:7644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790918975.108826:0:7644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790918975.108827:0:7644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790918975.108828:0:7644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790918975.108829:0:7644:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790918975.108829:0:7644:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790918975.108830:0:7644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790918975.108831:0:7644:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790918975.108870:0:7644:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1790918975.108887:0:7644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7644:1877914550289408:0@lo:253: 00000100:00100000:3.0:1790918975.108949:0:7644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918975.108996:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550289408 00000100:00100000:3.0:1790918975.109003:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550289408 00000100:00100000:3.0:1790918975.109054:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1790918975.109061:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+14:7644:x1877914550289408:12345-0@lo:253: 20000000:01000000:3.0:1790918975.109097:0:5840:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1790918975.109110:0:5840:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1790918975.110160:0:7658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be85f3aa00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7658:1877914550289536:0@lo:901: 00000100:00100000:2.0:1790918975.110205:0:7658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918975.110238:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550289536 00000100:00100000:2.0:1790918975.110242:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550289536 00000100:00100000:2.0:1790918975.110276:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790918975.110283:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be85f38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7658:x1877914550289536:12345-0@lo:901: 00000100:00100000:2.0:1790918975.110621:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be85f38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7658:x1877914550289536:12345-0@lo:901: Request processed in 337us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918975.110629:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1790918975.110778:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790918975.110793:0:7658:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be82d60f00 going to sleep for 11 seconds 00010000:00080000:2.0:1790918975.110817:0:7658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88be85f3aa00 x1877914550289536/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1790918991 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790918975.110831:0:7658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be85f3aa00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7658:1877914550289536:0@lo:901: 00000100:00100000:0.0:1790918975.112160:0:7644:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb3f48840 going to sleep for 11 seconds 20000000:01000000:1.0:1790918975.190684:0:5840:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790918975.190706:0:5840:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1790918975.194126:0:5861:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790918975.194136:0:5861:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790918975.194160:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88be81516400/0xc3296956897c4187 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918975.194179:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88be81673a00/0xc3296956897c40d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c40d1 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918975.194189:0:5861:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88be81516400/0xc3296956897c4187 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918975.194231:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88be81673a00/0xc3296956897c40d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3296956897c40d1 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918975.194247:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88be81673a00/0xc3296956897c40d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3296956897c40d1 expref: 14 pid: 5839 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790918975.194263:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db6d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1877914550289664:0@lo:104: 00000100:00100000:3.0:1790918975.194337:0:5861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918975.194401:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be86b02e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790918975.194752:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550289664 00000100:00100000:2.0:1790918975.194761:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550289664 00000100:00100000:2.0:1790918975.194813:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790918975.194823:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88db5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+3:5861:x1877914550289664:12345-0@lo:104: 00010000:00010000:2.0:1790918975.194836:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.127@tcp lock: ffff88be81516c00/0xc3296956897c40d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c40d8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918975.194901:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790918975.194907:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88db5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+3:5861:x1877914550289664:12345-0@lo:104: Request processed in 87us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918975.194914:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1790918975.194915:0:7650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790918975.194921:0:7650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff88be81516c00/0xc3296956897c40d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c40d8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918975.194947:0:7650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81516c00 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:1.0:1790918975.194951:0:7650:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff88be81516c00/0xc3296956897c40d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3296956897c40d8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918975.194959:0:7650:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff88be81516c00/0xc3296956897c40d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3296956897c40d8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790918975.194966:0:7650:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff88be81516c00/0xc3296956897c40d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3296956897c40d8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790918975.194980:0:7650:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790918975.195012:0:7650:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff88be81516c00/0xc3296956897c40d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c40d8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918975.195019:0:7650:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790918975.195038:0:7650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff88be81516c00/0xc3296956897c40d1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c40d8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918975.195045:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff88be81516c00/0xc3296956897c40d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c40d8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918975.195062:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790918975.195064:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790918975.195066:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790918975.195074:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790918975.195085:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb35b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3307:1877914550289792:0@lo:103: 00000100:00100000:1.0:1790918975.195114:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918975.195769:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db6d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1877914550289664:0@lo:104: 00010000:00010000:3.0:1790918975.195791:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88be81516400/0xc3296956897c4187 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790918975.196941:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550289792 00000100:00100000:2.0:1790918975.196953:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550289792 00010000:00010000:2.0:1790918975.197064:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88be81673a00/0xc3296956897c40d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c40d1 expref: 15 pid: 5839 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790918975.197141:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790918975.197151:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be91cae450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+15:3307:x1877914550289792:12345-0@lo:103: 00010000:00010000:2.0:1790918975.197164:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790918975.197169:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88be81673a00/0xc3296956897c40d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c40d1 expref: 15 pid: 5839 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918975.197181:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88be81673a00/0xc3296956897c40d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3296956897c40d1 expref: 15 pid: 5839 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918975.197206:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be81673a00/0xc3296956897c40d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3296956897c40d1 expref: 15 pid: 5839 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918975.197222:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88be81516400/0xc3296956897c4187 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918975.197230:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be81516400/0xc3296956897c4187 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790918975.197245:0:5831:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003109599s 00010000:00010000:2.0:1790918975.197249:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88be81516400/0xc3296956897c4187 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918975.197256:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88be81516400/0xc3296956897c4187 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918975.197263:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88be81516400/0xc3296956897c4187 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918975.197270:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88be81516400/0xc3296956897c4187 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918975.197275:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81516400 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:2.0:1790918975.197280:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88be81516400/0xc3296956897c4187 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918975.197287:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88be81516400/0xc3296956897c4187 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918975.197314:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88be81516400/0xc3296956897c4187 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918975.197335:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790918975.197400:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be91cae450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+14:3307:x1877914550289792:12345-0@lo:103: Request processed in 250us (2284us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918975.197422:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1790918975.200608:0:5861:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88be81516400/0xc3296956897c4187 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918975.200627:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88be81516400/0xc3296956897c4187 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918975.200643:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be81516400/0xc3296956897c4187 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790918975.200976:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb35b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3307:1877914550289792:0@lo:103: 00000100:00100000:0.0:1790918975.216137:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:7644:x1877914550289408:12345-0@lo:253: Request processed in 107064us (107177us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918975.216154:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1790918975.216240:0:7644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7644:1877914550289408:0@lo:253: 10000000:01000000:3.0:1790918975.216257:0:7644:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1790918975.216260:0:7644:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790918975.216262:0:7644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790918975.216264:0:7644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790918975.216265:0:7644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790918975.216266:0:7644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790918975.216267:0:7644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790918975.216268:0:7644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790918975.216270:0:7644:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790918975.216271:0:7644:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790918975.216273:0:7644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790918975.216274:0:7644:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1790918975.216287:0:7644:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1790918975.232304:0:7644:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1790918975.232509:0:7644:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1790918975.233482:0:7644:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1790918975.234169:0:7644:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1790918975.234393:0:7644:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1790918975.235161:0:7644:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1790918975.240320:0:7644:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1790918975.476768:0:7644:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1790918975.476776:0:7644:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1790918975.476806:0:7644:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790918975.476872:0:7644:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.127@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790918975.476888:0:7644:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1790918975.476914:0:7644:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1790918975.746029:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790918976.770949:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790918977.794843:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790918978.815770:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790918979.331045:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88d99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550289920:0@lo:13: 00000100:00100000:0.0:1790918979.331198:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918979.331491:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550289920 00000100:00100000:1.0:1790918979.331500:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550289920 00000100:00100000:1.0:1790918979.331578:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790918979.331588:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550289920:12345-0@lo:13: 00002000:00000024:1.0:1790918979.331626:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790918979.331684:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550289920:12345-0@lo:13: Request processed in 98us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918979.331691:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1790918979.331761:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88be88d99f80 x1877914550289920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790918995 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790918979.331766:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790918979.331797:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88d99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550289920:0@lo:13: 00010000:00010000:3.0:1790918979.848670:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790918980.355726:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be85f3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877914550290176:0@lo:400: 00000100:00100000:2.0:1790918980.355810:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918980.355870:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790918980.355876:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be85f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1877914550290304:0@lo:400: 00000100:00100000:2.0:1790918980.355897:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918980.355931:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550290176 00000100:00100000:2.0:1790918980.355938:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550290176 00000100:00100000:2.0:1790918980.355975:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550290304 00000100:00100000:2.0:1790918980.355977:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550290304 00000100:00100000:2.0:1790918980.356002:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790918980.356010:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd82803800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877914550290176:12345-0@lo:400: 00000100:00100000:2.0:1790918980.356058:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd82803800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877914550290176:12345-0@lo:400: Request processed in 49us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918980.356065:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790918980.356083:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790918980.356089:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd82802680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877914550290304:12345-0@lo:400: 00000100:00100000:2.0:1790918980.356115:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd82802680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877914550290304:12345-0@lo:400: Request processed in 27us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918980.356120:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1790918980.356135:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790918980.356163:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88be85f38a80 x1877914550290304/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790918996 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790918980.356186:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be85f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1877914550290304:0@lo:400: 00010000:00080000:2.0:1790918980.356199:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88be85f3aa00 x1877914550290176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790918996 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790918980.356206:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be85f3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877914550290176:0@lo:400: 00000100:00100000:0.0:1790918980.357405:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be85f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3306:1877914550290048:0@lo:400: 00000100:00100000:0.0:1790918980.357718:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790918980.357797:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd82801500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1877914550290560:0@lo:400: 00000100:00100000:0.0:1790918980.357825:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790918980.357845:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790918980.357850:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd82803480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550290432:0@lo:400: 00000100:00100000:0.0:1790918980.357870:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790918980.357904:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550290560 00000100:00100000:0.0:1790918980.357909:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550290560 00000100:00100000:0.0:1790918980.357944:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790918980.357951:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88d99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877914550290560:12345-0@lo:400: 00000100:00100000:0.0:1790918980.357993:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88d99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877914550290560:12345-0@lo:400: Request processed in 42us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918980.357999:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790918980.358020:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550290432 00000100:00100000:0.0:1790918980.358024:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550290432 00000100:00100000:0.0:1790918980.358045:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790918980.358051:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88d98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550290432:12345-0@lo:400: 00000100:00100000:0.0:1790918980.358081:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88d98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550290432:12345-0@lo:400: Request processed in 30us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918980.358087:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790918980.358115:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bd82803480 x1877914550290432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790918996 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790918980.358128:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd82803480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550290432:0@lo:400: 00010000:00080000:0.0:1790918980.358138:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bd82801500 x1877914550290560/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790918996 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790918980.358146:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd82801500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1877914550290560:0@lo:400: 00000100:00080000:0.0:1790918980.358168:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790918980.358462:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550290048 00000100:00100000:2.0:1790918980.358467:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550290048 00000100:00100000:2.0:1790918980.358578:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1790918980.358589:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:3306:x1877914550290048:12345-0@lo:400: 00000100:00100000:2.0:1790918980.358630:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:3306:x1877914550290048:12345-0@lo:400: Request processed in 44us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918980.358637:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790918980.361080:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be85f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3306:1877914550290048:0@lo:400: 00010000:00010000:0.0:1790918980.874110:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790918981.888764:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790918981.889433:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1790918981.889439:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88be86b70000 from 30 10000000:01000000:0.0:1790918981.889445:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790918981.889486:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88bd81146200/0xc3296956897c418e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918981.889498:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88bd81146200/0xc3296956897c418e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918981.889511:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88bd81146200/0xc3296956897c418e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790918981.889552:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88d99880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550290688:0@lo:101: 00000100:00100000:0.0:1790918981.889624:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790918981.889681:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be84c9de40 going to sleep for 11 seconds 00000100:00100000:1.0:1790918981.889765:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550290688 00000100:00100000:1.0:1790918981.889774:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550290688 00000100:00100000:1.0:1790918981.889825:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1790918981.889834:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:5842:x1877914550290688:12345-0@lo:101: 00010000:00010000:1.0:1790918981.889848:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790918981.889861:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be81673800/0xc3296956897c4195 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c418e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918981.889886:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be81673800/0xc3296956897c4195 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c418e expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918981.889896:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be81673800/0xc3296956897c4195 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c418e expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918981.889905:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81673800, rc 0) 00000100:00100000:1.0:1790918981.890024:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+14:5842:x1877914550290688:12345-0@lo:101: Request processed in 191us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918981.890031:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790918981.894391:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88d99880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550290688:0@lo:101: 00010000:00010000:0.0:1790918981.894430:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88bd81146200/0xc3296956897c418e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c4195 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918981.894442:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88bd81146200/0xc3296956897c418e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c4195 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790918981.894517:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88d99880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550290816:0@lo:501: 00000100:00100000:0.0:1790918981.894606:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790918981.894642:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be84c9de40 going to sleep for 11 seconds 00000100:00100000:2.0:1790918981.894725:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550290816 00000100:00100000:2.0:1790918981.894742:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550290816 00000100:00100000:2.0:1790918981.894796:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1790918981.894806:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+14:5842:x1877914550290816:12345-0@lo:501: 00000100:00100000:2.0:1790918981.895145:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+14:5842:x1877914550290816:12345-0@lo:501: Request processed in 339us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918981.895152:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1790918981.895190:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88d99880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550290816:0@lo:501: 00000100:00100000:2.0:1790918981.895216:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd82800700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550290944:0@lo:503: 00000100:00100000:2.0:1790918981.895264:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918981.895278:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb44eba80 going to sleep for 11 seconds 00000100:00100000:2.0:1790918981.895291:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550290944 00000100:00100000:2.0:1790918981.895294:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550290944 00000100:00100000:2.0:1790918981.895323:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1790918981.895329:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+14:5842:x1877914550290944:12345-0@lo:503: 00000100:00100000:2.0:1790918981.895626:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+14:5842:x1877914550290944:12345-0@lo:503: Request processed in 296us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918981.895632:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1790918981.895667:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd82800700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550290944:0@lo:503: 00000100:00100000:2.0:1790918981.895845:0:7984:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd82800700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7984:1877914550291072:0@lo:502: 00000100:00100000:2.0:1790918981.895878:0:7984:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918981.895896:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550291072 00000100:00100000:2.0:1790918981.895899:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550291072 00000100:00100000:2.0:1790918981.895920:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1790918981.895925:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+14:7984:x1877914550291072:12345-0@lo:502: 00000100:00100000:2.0:1790918981.896113:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+14:7984:x1877914550291072:12345-0@lo:502: Request processed in 186us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918981.896119:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1790918981.896148:0:7984:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb44ebb40 going to sleep for 11 seconds 00000100:00100000:2.0:1790918981.896158:0:7984:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd82800700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7984:1877914550291072:0@lo:502: 00000100:00100000:2.0:1790918981.896196:0:7984:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd82800700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7984:1877914550291200:0@lo:502: 00000100:00100000:2.0:1790918981.896225:0:7984:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918981.896243:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550291200 00000100:00100000:2.0:1790918981.896246:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550291200 00000100:00100000:2.0:1790918981.896265:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1790918981.896271:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+14:7984:x1877914550291200:12345-0@lo:502: 00000100:00100000:2.0:1790918981.896377:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+14:7984:x1877914550291200:12345-0@lo:502: Request processed in 106us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918981.896392:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1790918981.896419:0:7984:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb44ebb40 going to sleep for 11 seconds 00000100:00100000:2.0:1790918981.896429:0:7984:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd82800700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7984:1877914550291200:0@lo:502: 00000040:00080000:2.0:1790918981.896445:0:7984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1790918981.896487:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1790918981.896503:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790918981.896511:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88bd81146200/0xc3296956897c418e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c4195 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918981.896522:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88bd81146200/0xc3296956897c418e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c4195 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790918981.896553:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1790918981.896556:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1790918981.896559:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1790918981.896583:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be88386000/0xc3296956897c419c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918981.896591:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88be88386000/0xc3296956897c419c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918981.896600:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88be88386000/0xc3296956897c419c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790918981.896611:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd82800700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550291328:0@lo:101: 00000100:00100000:2.0:1790918981.896636:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918981.896648:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb44ebb40 going to sleep for 11 seconds 00000100:00100000:2.0:1790918981.896658:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550291328 00000100:00100000:2.0:1790918981.896661:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550291328 00000100:00100000:2.0:1790918981.896686:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1790918981.896692:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+14:5842:x1877914550291328:12345-0@lo:101: 00010000:00010000:2.0:1790918981.896699:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790918981.896710:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be88386200/0xc3296956897c41a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c419c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918981.896729:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be88386200/0xc3296956897c41a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c419c expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918981.896752:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be88386200/0xc3296956897c41a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c419c expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918981.896761:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be88386200, rc 0) 00000100:00100000:2.0:1790918981.896789:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+15:5842:x1877914550291328:12345-0@lo:101: Request processed in 97us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918981.896795:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1790918981.896823:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd82800700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550291328:0@lo:101: 00010000:00010000:2.0:1790918981.896834:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88be88386000/0xc3296956897c419c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c41a3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918981.896843:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88be88386000/0xc3296956897c419c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c41a3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790918981.896877:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd82800700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550291456:0@lo:501: 00000100:00100000:2.0:1790918981.896902:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918981.896916:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb44ebb40 going to sleep for 11 seconds 00000100:00100000:2.0:1790918981.896927:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550291456 00000100:00100000:2.0:1790918981.896930:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550291456 00000100:00100000:2.0:1790918981.896949:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1790918981.896959:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+15:5842:x1877914550291456:12345-0@lo:501: 00000100:00100000:2.0:1790918981.897134:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+15:5842:x1877914550291456:12345-0@lo:501: Request processed in 174us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918981.897141:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1790918981.897170:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd82800700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550291456:0@lo:501: 00000100:00100000:2.0:1790918981.897192:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd82800700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550291584:0@lo:503: 00000100:00100000:2.0:1790918981.897222:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918981.897235:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb44ebb40 going to sleep for 11 seconds 00000100:00100000:2.0:1790918981.897247:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550291584 00000100:00100000:2.0:1790918981.897250:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550291584 00000100:00100000:2.0:1790918981.897269:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790918981.897274:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+15:5842:x1877914550291584:12345-0@lo:503: 00000100:00100000:2.0:1790918981.897559:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+15:5842:x1877914550291584:12345-0@lo:503: Request processed in 283us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918981.897566:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790918981.897683:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd82800700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550291584:0@lo:503: 00000100:00100000:3.0:1790918981.902998:0:7985:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7985:1877914550291712:0@lo:502: 00000100:00100000:3.0:1790918981.903081:0:7985:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918981.903163:0:7985:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bebfbc9480 going to sleep for 11 seconds 00000100:00100000:2.0:1790918981.905388:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550291712 00000100:00100000:2.0:1790918981.905468:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550291712 00000100:00100000:2.0:1790918981.905608:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790918981.905620:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+15:7985:x1877914550291712:12345-0@lo:502: 00000100:00100000:2.0:1790918981.905942:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+15:7985:x1877914550291712:12345-0@lo:502: Request processed in 325us (2860us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918981.905950:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1790918981.907675:0:7985:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7985:1877914550291712:0@lo:502: 00000020:01000000:1.0:1790918981.907720:0:7985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790918981.907729:0:7985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790918981.907742:0:7985:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790918981.907747:0:7985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790918981.907749:0:7985:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1790918981.907781:0:7985:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb35b1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7985:1877914550291840:0@lo:502: 00000100:00100000:1.0:1790918981.907834:0:7985:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918981.908302:0:7985:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bebfb3d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790918981.909894:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550291840 00000100:00100000:2.0:1790918981.909908:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550291840 00000100:00100000:2.0:1790918981.909959:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790918981.909977:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+15:7985:x1877914550291840:12345-0@lo:502: 00000100:00100000:2.0:1790918981.911705:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+15:7985:x1877914550291840:12345-0@lo:502: Request processed in 1722us (3863us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918981.911718:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790918981.911809:0:7985:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb35b1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7985:1877914550291840:0@lo:502: 00000020:01000000:2.0:1790918981.911846:0:7985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790918981.911853:0:7985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790918981.911855:0:7985:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1790918981.911861:0:7985:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1790918981.911974:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1790918981.911993:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1790918981.912002:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be88386000/0xc3296956897c419c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c41a3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918981.912013:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88be88386000/0xc3296956897c419c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c41a3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790918981.912023:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1790918981.912026:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88be91614800 from 30 10000000:01000000:2.0:1790918981.912028:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790918981.912058:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be88386a00/0xc3296956897c41aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918981.912067:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88be88386a00/0xc3296956897c41aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918981.912076:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88be88386a00/0xc3296956897c41aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790918981.912094:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd82800700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550291968:0@lo:101: 00000100:00100000:2.0:1790918981.912138:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918981.912165:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb44eba80 going to sleep for 11 seconds 00000100:00100000:2.0:1790918981.912313:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550291968 00000100:00100000:2.0:1790918981.912319:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550291968 00000100:00100000:2.0:1790918981.912344:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1790918981.912351:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+15:5842:x1877914550291968:12345-0@lo:101: 00010000:00010000:2.0:1790918981.912362:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790918981.912373:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be88387000/0xc3296956897c41b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c41aa expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918981.912465:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be88387000/0xc3296956897c41b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c41aa expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918981.912478:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be88387000/0xc3296956897c41b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c41aa expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918981.912487:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be88387000, rc 0) 00000100:00100000:2.0:1790918981.912520:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+16:5842:x1877914550291968:12345-0@lo:101: Request processed in 168us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918981.912551:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1790918981.912580:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd82800700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550291968:0@lo:101: 00010000:00010000:2.0:1790918981.912592:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88be88386a00/0xc3296956897c41aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c41b1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918981.912601:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88be88386a00/0xc3296956897c41aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c41b1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790918981.912642:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd82800700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550292096:0@lo:501: 00000100:00100000:2.0:1790918981.912675:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918981.912687:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb44eba80 going to sleep for 11 seconds 00000100:00100000:2.0:1790918981.912698:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550292096 00000100:00100000:2.0:1790918981.912702:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550292096 00000100:00100000:2.0:1790918981.912718:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1790918981.912723:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+16:5842:x1877914550292096:12345-0@lo:501: 00000100:00100000:2.0:1790918981.912978:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+16:5842:x1877914550292096:12345-0@lo:501: Request processed in 253us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918981.912985:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1790918981.913011:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd82800700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550292096:0@lo:501: 00000100:00100000:2.0:1790918981.913034:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd82800700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550292224:0@lo:503: 00000100:00100000:2.0:1790918981.913069:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918981.913082:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb44eba80 going to sleep for 11 seconds 00000100:00100000:2.0:1790918981.913092:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550292224 00000100:00100000:2.0:1790918981.913095:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550292224 00000100:00100000:2.0:1790918981.913110:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1790918981.913115:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87167450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+16:5842:x1877914550292224:12345-0@lo:503: 00000100:00100000:2.0:1790918981.915694:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87167450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+16:5842:x1877914550292224:12345-0@lo:503: Request processed in 2568us (2615us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918981.915709:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1790918981.917577:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd82800700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550292224:0@lo:503: 00000100:00100000:2.0:1790918981.921597:0:7987:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd82800000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7987:1877914550292352:0@lo:502: 00000100:00100000:2.0:1790918981.921697:0:7987:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918981.921728:0:7987:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be88024d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790918981.922355:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550292352 00000100:00100000:3.0:1790918981.922364:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550292352 00000100:00100000:3.0:1790918981.922421:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1790918981.922432:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+16:7987:x1877914550292352:12345-0@lo:502: 00000100:00100000:3.0:1790918981.922715:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+16:7987:x1877914550292352:12345-0@lo:502: Request processed in 284us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918981.922723:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1790918981.927834:0:7987:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd82800000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7987:1877914550292352:0@lo:502: 00000100:00100000:2.0:1790918981.927923:0:7987:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd82800000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7987:1877914550292480:0@lo:502: 00000100:00100000:2.0:1790918981.928010:0:7987:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918981.928051:0:7987:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be88024d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790918981.929878:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550292480 00000100:00100000:3.0:1790918981.929893:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550292480 00000100:00100000:3.0:1790918981.929952:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1790918981.929962:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87165c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+16:7987:x1877914550292480:12345-0@lo:502: 00000100:00100000:3.0:1790918981.930257:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87165c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+16:7987:x1877914550292480:12345-0@lo:502: Request processed in 295us (2246us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918981.930266:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1790918981.932601:0:7987:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd82800000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7987:1877914550292480:0@lo:502: 00000040:00080000:2.0:1790918981.932642:0:7987:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1790918981.949591:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1790918981.949629:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790918981.949641:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be88386a00/0xc3296956897c41aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c41b1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918981.949652:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88be88386a00/0xc3296956897c41aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c41b1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790918981.949660:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790918981.949676:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88be91614800 from 5 10000000:01000000:3.0:1790918981.949679:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790918981.949718:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be81517c00/0xc3296956897c41b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918981.949726:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88be81517c00/0xc3296956897c41b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918981.949748:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88be81517c00/0xc3296956897c41b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790918981.949774:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550292608:0@lo:101: 00000100:00100000:3.0:1790918981.949844:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918981.949881:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bebfbc9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790918981.949902:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550292608 00000100:00100000:3.0:1790918981.949908:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550292608 00000100:00100000:3.0:1790918981.949951:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1790918981.949959:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+16:5842:x1877914550292608:12345-0@lo:101: 00010000:00010000:3.0:1790918981.949972:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790918981.949984:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be81517e00/0xc3296956897c41bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c41b8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918981.950004:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be81517e00/0xc3296956897c41bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c41b8 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918981.950013:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be81517e00/0xc3296956897c41bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c41b8 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918981.950021:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81517e00, rc 0) 00000100:00100000:3.0:1790918981.950054:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:5842:x1877914550292608:12345-0@lo:101: Request processed in 96us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918981.950066:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1790918981.950112:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550292608:0@lo:101: 00010000:00010000:3.0:1790918981.950124:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88be81517c00/0xc3296956897c41b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c41bf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918981.950133:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88be81517c00/0xc3296956897c41b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c41bf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790918981.950414:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550292736:0@lo:256: 00000100:00100000:3.0:1790918981.950446:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918981.950501:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bebfbc9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790918981.961812:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550292736 00000100:00100000:2.0:1790918981.961828:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550292736 00000100:00100000:2.0:1790918981.962021:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1790918981.962031:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87166c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:5842:x1877914550292736:12345-0@lo:256: 20000000:01000000:2.0:1790918981.962058:0:5839:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790918981.962084:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790918981.962087:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1790918981.962227:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87166c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:5842:x1877914550292736:12345-0@lo:256: Request processed in 197us (11780us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918981.962235:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1790918981.962591:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550292736:0@lo:256: 10000000:01000000:3.0:1790918981.962654:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790918981.962664:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be81517c00/0xc3296956897c41b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c41bf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918981.962677:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88be81517c00/0xc3296956897c41b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c41bf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790918981.962688:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1790918981.962691:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1790918981.962694:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1790918981.962725:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be81517400/0xc3296956897c41c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918981.962744:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88be81517400/0xc3296956897c41c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918981.962763:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88be81517400/0xc3296956897c41c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790918981.962782:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550292864:0@lo:101: 00000100:00100000:3.0:1790918981.962816:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918981.962852:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bebfbc9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790918981.963081:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550292864 00000100:00100000:2.0:1790918981.963087:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550292864 00000100:00100000:2.0:1790918981.963127:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1790918981.963135:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:5842:x1877914550292864:12345-0@lo:101: 00010000:00010000:2.0:1790918981.963144:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790918981.963157:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be88387400/0xc3296956897c41cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c41c6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918981.963193:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be88387400/0xc3296956897c41cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c41c6 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918981.963206:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be88387400/0xc3296956897c41cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c41c6 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918981.963214:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be88387400, rc 0) 00000100:00100000:2.0:1790918981.963253:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:5842:x1877914550292864:12345-0@lo:101: Request processed in 119us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918981.963259:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1790918981.963403:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550292864:0@lo:101: 00010000:00010000:3.0:1790918981.963419:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88be81517400/0xc3296956897c41c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c41cd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918981.963427:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88be81517400/0xc3296956897c41c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c41cd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790918981.963483:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550292992:0@lo:501: 00000100:00100000:3.0:1790918981.963507:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918981.963550:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bebfbc9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790918981.963561:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550292992 00000100:00100000:3.0:1790918981.963564:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550292992 00000100:00100000:3.0:1790918981.963587:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1790918981.963594:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:5842:x1877914550292992:12345-0@lo:501: 00000100:00100000:3.0:1790918981.964111:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:5842:x1877914550292992:12345-0@lo:501: Request processed in 517us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918981.964118:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1790918981.964162:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550292992:0@lo:501: 00000100:00100000:2.0:1790918981.964187:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd82800000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550293120:0@lo:503: 00000100:00100000:2.0:1790918981.964219:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918981.964232:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be88024300 going to sleep for 11 seconds 00000100:00100000:2.0:1790918981.964245:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550293120 00000100:00100000:2.0:1790918981.964249:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550293120 00000100:00100000:2.0:1790918981.964266:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1790918981.964272:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:5842:x1877914550293120:12345-0@lo:503: 00000100:00100000:2.0:1790918981.964564:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:5842:x1877914550293120:12345-0@lo:503: Request processed in 291us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918981.964571:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1790918981.964605:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd82800000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550293120:0@lo:503: 00000100:00100000:2.0:1790918981.974233:0:7991:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd82800000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7991:1877914550293248:0@lo:502: 00000100:00100000:2.0:1790918981.974325:0:7991:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918981.974373:0:7991:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be88024300 going to sleep for 11 seconds 00000100:00100000:0.0:1790918981.977903:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550293248 00000100:00100000:0.0:1790918981.977918:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550293248 00000100:00100000:0.0:1790918981.978006:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1790918981.978017:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:7991:x1877914550293248:12345-0@lo:502: 00000100:00100000:0.0:1790918981.979478:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:7991:x1877914550293248:12345-0@lo:502: Request processed in 1457us (5148us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918981.979490:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1790918981.979985:0:7991:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd82800000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7991:1877914550293248:0@lo:502: 00000020:01000000:1.0:1790918981.980021:0:7991:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790918981.980029:0:7991:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1790918981.980037:0:7991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790918981.980039:0:7991:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1790918981.980044:0:7991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790918981.980048:0:7991:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.127@tcp to nid 0x20000c0a8c97f (192.168.201.127@tcp) 00000020:01000000:1.0:1790918981.980073:0:7991:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1790918981.980076:0:7991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790918981.980092:0:7991:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff88bebaa34d40) 00000020:00000080:1.0:1790918981.980114:0:7991:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1790918981.980121:0:7991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790918981.980214:0:7991:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1790918981.980221:0:7991:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1790918981.980228:0:7991:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3296956897c41db 00010000:00080000:1.0:1790918981.980263:0:7991:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88be88c1e000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.127@tcp at head 00010000:00010000:1.0:1790918981.980503:0:7991:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1790918981.980932:0:7991:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1790918981.980949:0:7991:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1790918981.981494:0:7991:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790918981.981801:0:7991:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790918981.981857:0:7991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1790918981.981930:0:7991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1790918981.987081:0:7993:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790918981.987090:0:7993:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1790918981.995413:0:7991:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790918981.995429:0:7991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1790918981.995483:0:7991:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1790918981.998240:0:7991:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3296956897c41e2 00000100:00080000:2.0:1790918981.998262:0:7991:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790918981.998276:0:7991:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88be88c1e000 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:2.0:1790918981.998318:0:7991:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88bd82801180 x1877914550293376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790918981.998360:0:7991:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1790918981.998461:0:7991:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790918981.998467:0:7991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790918981.998470:0:7991:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1790918981.998473:0:7991:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790918981.998571:0:7991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790918981.998573:0:7991:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790918981.998579:0:7991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790918981.998580:0:7991:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1790918981.998614:0:7991:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd82802300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7991:1877914550293504:0@lo:502: 00000100:00100000:2.0:1790918981.998788:0:7991:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918981.998959:0:7991:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb3f48840 going to sleep for 11 seconds 00000100:00100000:2.0:1790918981.998979:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd82801180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1877914550293376:0@lo:8: 00000100:00100000:2.0:1790918981.999015:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918981.999103:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550293376 00000100:00100000:2.0:1790918981.999110:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550293376 00000100:00100000:2.0:1790918981.999144:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790918981.999151:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd82803100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3304:x1877914550293376:12345-0@lo:8: 00010000:00080000:2.0:1790918981.999175:0:6700:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 183 last 0 00000020:00000080:2.0:1790918981.999203:0:6700:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3296956897c41e9 00002000:00100000:2.0:1790918981.999218:0:6700:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff88bd82853000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1790918981.999223:0:6700:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1790918981.999227:0:6700:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1790918981.999371:0:6700:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1790918982.000282:0:6700:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790918982.000313:0:6700:0:(import.c:65:import_set_state_nolock()) ffff88bd82852800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790918982.000383:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd82803100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1877914550293376:12345-0@lo:8: Request processed in 1230us (1366us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918982.000398:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790918982.000451:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd82803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877914550293632:0@lo:400: 00010000:00080000:3.0:1790918982.000608:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bd82801180 x1877914550293376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790918991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790918982.000690:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790918982.000697:0:3304:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1790918982.000705:0:3304:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1790918982.000711:0:3304:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1790918982.000713:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88be88c1e000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1790918982.000740:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1790918982.000745:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd82801180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1877914550293376:0@lo:8: 00000004:00080000:3.0:1790918982.000771:0:7993:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1790918982.001589:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918982.001702:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790918982.001710:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd82800380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1877914550293760:0@lo:400: 00000100:00100000:2.0:1790918982.001758:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918982.002935:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd82802a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550293888:0@lo:400: 00000100:00100000:0.0:1790918982.003579:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550293632 00000100:00100000:0.0:1790918982.003589:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550293632 00000100:00100000:0.0:1790918982.003727:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550293760 00000100:00100000:0.0:1790918982.003741:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550293760 00000100:00100000:0.0:1790918982.003769:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790918982.003778:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd82800e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877914550293632:12345-0@lo:400: 00000100:00100000:0.0:1790918982.003944:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd82800e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877914550293632:12345-0@lo:400: Request processed in 166us (2357us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918982.003951:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790918982.003967:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790918982.003974:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd82801880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877914550293760:12345-0@lo:400: 00000100:00100000:0.0:1790918982.004007:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd82801880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877914550293760:12345-0@lo:400: Request processed in 34us (2248us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918982.004012:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1790918982.004030:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790918982.004239:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd82801c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1877914550294016:0@lo:400: 00000100:00100000:2.0:1790918982.004280:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918982.004410:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550294016 00000100:00100000:2.0:1790918982.004414:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550294016 00000100:00100000:2.0:1790918982.004443:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790918982.004449:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd82802d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877914550294016:12345-0@lo:400: 00000100:00100000:2.0:1790918982.004953:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd82802d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877914550294016:12345-0@lo:400: Request processed in 503us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918982.004962:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1790918982.005011:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bd82801c00 x1877914550294016/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790918998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790918982.005026:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd82801c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1877914550294016:0@lo:400: 00000100:00080000:2.0:1790918982.005048:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790918982.005067:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bd82800380 x1877914550293760/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790918998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790918982.005077:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd82800380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1877914550293760:0@lo:400: 00010000:00080000:2.0:1790918982.005092:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bd82803b80 x1877914550293632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790918997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790918982.005111:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd82803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877914550293632:0@lo:400: 00000100:00100000:2.0:1790918982.005158:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918982.005196:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550293888 00000100:00100000:2.0:1790918982.005200:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550293888 00000100:00100000:2.0:1790918982.005236:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790918982.005244:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd82803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550293888:12345-0@lo:400: 00000100:00100000:2.0:1790918982.005288:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd82803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550293888:12345-0@lo:400: Request processed in 46us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918982.005295:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1790918982.005603:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790918982.005639:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bd82802a00 x1877914550293888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790918998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790918982.005649:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd82802a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550293888:0@lo:400: 00000100:00100000:2.0:1790918982.005673:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550293504 00000100:00100000:2.0:1790918982.005677:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550293504 00000100:00100000:2.0:1790918982.005716:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1790918982.005726:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:7991:x1877914550293504:12345-0@lo:502: 00000100:00100000:2.0:1790918982.006410:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:7991:x1877914550293504:12345-0@lo:502: Request processed in 685us (7622us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918982.006418:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1790918982.006469:0:7991:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd82802300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:7991:1877914550293504:0@lo:502: 00000020:01000000:2.0:1790918982.006498:0:7991:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790918982.006506:0:7991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790918982.006508:0:7991:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:2.0:1790918982.006514:0:7991:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1790918982.007411:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1790918982.007435:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1790918982.007446:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be81517400/0xc3296956897c41c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c41cd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918982.007459:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88be81517400/0xc3296956897c41c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c41cd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790918982.007469:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1790918982.007472:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff88be88d33380 from 1 10000000:01000000:3.0:1790918982.007482:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1790918982.007515:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be81516400/0xc3296956897c41f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918982.007550:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88be81516400/0xc3296956897c41f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918982.007561:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88be81516400/0xc3296956897c41f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790918982.007581:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550294144:0@lo:101: 00000100:00100000:3.0:1790918982.007647:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918982.007682:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bebfbc96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790918982.007700:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550294144 00000100:00100000:3.0:1790918982.007706:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550294144 00000100:00100000:3.0:1790918982.007755:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1790918982.007769:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87166050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:5842:x1877914550294144:12345-0@lo:101: 00010000:00010000:3.0:1790918982.007971:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790918982.007986:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be81516c00/0xc3296956897c41f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c41f0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918982.008008:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be81516c00/0xc3296956897c41f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c41f0 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918982.008018:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be81516c00/0xc3296956897c41f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c41f0 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918982.008026:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81516c00, rc 0) 00000100:00100000:3.0:1790918982.008062:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87166050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:5842:x1877914550294144:12345-0@lo:101: Request processed in 299us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918982.008070:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1790918982.008108:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550294144:0@lo:101: 00010000:00010000:3.0:1790918982.008121:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88be81516400/0xc3296956897c41f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c41f7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918982.008129:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88be81516400/0xc3296956897c41f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c41f7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790918982.008174:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550294272:0@lo:501: 00000100:00100000:3.0:1790918982.008209:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918982.008220:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bebfbc96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790918982.008571:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550294272 00000100:00100000:2.0:1790918982.008580:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550294272 00000100:00100000:2.0:1790918982.008604:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1790918982.008610:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87164c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:5842:x1877914550294272:12345-0@lo:501: 00000004:00080000:3.0:1790918982.008714:0:7993:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 183897186802ns, next at 0ns, rc = 0 00000100:00100000:2.0:1790918982.009249:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87164c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:5842:x1877914550294272:12345-0@lo:501: Request processed in 638us (1038us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790918982.009257:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1790918982.009297:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550294272:0@lo:501: 10000000:01000000:2.0:1790918982.009320:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1790918982.009326:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be81516400/0xc3296956897c41f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c41f7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918982.009334:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88be81516400/0xc3296956897c41f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c41f7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790918982.043979:0:7997:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1790918982.044013:0:7997:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7997:1877914550294528:0@lo:7: 00000100:00100000:3.0:1790918982.044090:0:7997:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918982.044124:0:7997:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bebfbc9480 going to sleep for 11 seconds 00000100:00100000:3.0:1790918982.044587:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790918982.044600:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550294400:0@lo:13: 00000100:00100000:3.0:1790918982.044629:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790918982.044737:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550294400 00000100:00100000:0.0:1790918982.044745:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550294400 00000100:00100000:0.0:1790918982.044887:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790918982.044898:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88db5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1877914550294400:12345-0@lo:13: 00002000:00000024:0.0:1790918982.044932:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1790918982.044984:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88db5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1877914550294400:12345-0@lo:13: Request processed in 88us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918982.044992:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1790918982.045048:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88be88db4380 x1877914550294400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790918998 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790918982.045067:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550294400:0@lo:13: 00000100:00100000:2.0:1790918982.047116:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550294528 00000100:00100000:2.0:1790918982.047128:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550294528 00000100:00100000:2.0:1790918982.047179:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790918982.047201:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88db4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7997:x1877914550294528:12345-0@lo:7: 00000100:00080000:3.0:1790918982.049064:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:2.0:1790918982.058776:0:6699:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1790918982.058786:0:6699:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1790918982.058888:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88db4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7997:x1877914550294528:12345-0@lo:7: Request processed in 11685us (14791us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918982.058900:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1790918982.058955:0:7997:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88be88db5880 x1877914550294528/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790918998 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790918982.058971:0:7997:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7997:1877914550294528:0@lo:7: 00000004:00080000:2.0:1790918982.058985:0:7997:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1790918982.059034:0:7997:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd82802300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7997:1877914550294656:0@lo:5: 00000100:00100000:2.0:1790918982.059068:0:7997:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918982.059091:0:7997:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb3f48c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790918982.059108:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550294656 00000100:00100000:2.0:1790918982.059114:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550294656 00000100:00100000:2.0:1790918982.059144:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790918982.059153:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd82802a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7997:x1877914550294656:12345-0@lo:5: 00002000:00080000:2.0:1790918982.059178:0:6698:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1790918982.059181:0:6698:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1790918982.059345:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd82802a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7997:x1877914550294656:12345-0@lo:5: Request processed in 193us (276us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1790918982.059352:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1790918982.059377:0:7997:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bd82802300 x1877914550294656/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790918998 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790918982.059388:0:7997:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd82802300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7997:1877914550294656:0@lo:5: 00000004:00080000:3.0:1790918982.059397:0:7997:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1790918982.059420:0:7997:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7997:1877914550294784:0@lo:700: 00000100:00100000:3.0:1790918982.059444:0:7997:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918982.059468:0:7997:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bebfbc99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790918982.059520:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550294784 00000100:00100000:0.0:1790918982.059597:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550294784 00000100:00100000:0.0:1790918982.059759:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790918982.059767:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88db6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7997:x1877914550294784:12345-0@lo:700: 00000100:00100000:0.0:1790918982.060008:0:6706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88d98e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6706:1877914550294912:0@lo:700: 00000100:00100000:0.0:1790918982.060033:0:6706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790918982.060059:0:6706:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be8e285c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790918982.060077:0:5852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550294912 00000100:00100000:3.0:1790918982.060082:0:5852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550294912 00000100:00100000:3.0:1790918982.060108:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790918982.060113:0:5852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88d99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6706:x1877914550294912:12345-0@lo:700: 00000004:00080000:0.0:1790918982.086353:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000001:02000400:2.0:1790918982.117003:0:8009:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg127-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 40000000:02000000:3.0:1790918982.118842:0:5852:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1790918982.136599:0:5852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88d99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6706:x1877914550294912:12345-0@lo:700: Request processed in 76476us (76554us total) trans 0 rc 0/0 00010000:00080000:0.0:1790918982.136864:0:6706:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88be88d98e00 x1877914550294912/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790918998 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790918982.136880:0:6706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88d98e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6706:1877914550294912:0@lo:700: 40000000:02000000:0.0:1790918982.136895:0:6706:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:2.0:1790918982.137284:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790918982.249144:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88db6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7997:x1877914550294784:12345-0@lo:700: Request processed in 189373us (189693us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918982.249158:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790918982.249204:0:7997:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88be88db4000 x1877914550294784/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790918998 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000001:00080000:2.0:1790918982.249204:0:7662:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1790918982.249216:0:7662:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1790918982.249251:0:7997:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7997:1877914550294784:0@lo:700: 00000004:02000040:2.0:1790918982.316815:0:7997:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1790918982.321335:0:7997:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd82800380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7997:1877914550295040:0@lo:5: 00000100:00100000:2.0:1790918982.321412:0:7997:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918982.321933:0:7997:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be92487900 going to sleep for 11 seconds 00000100:00100000:1.0:1790918982.322026:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550295040 00000100:00100000:1.0:1790918982.322037:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550295040 00000100:00100000:1.0:1790918982.322101:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790918982.322112:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd82801c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7997:x1877914550295040:12345-0@lo:5: 00002000:00080000:2.0:1790918982.330110:0:6698:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1790918982.330133:0:6698:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1790918982.334408:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd82801c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7997:x1877914550295040:12345-0@lo:5: Request processed in 12291us (12989us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1790918982.334428:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1790918982.334567:0:7997:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bd82800380 x1877914550295040/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790918998 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790918982.334580:0:7997:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1790918982.334596:0:7997:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff88bd82800380 x1877914550295040/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790918998 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790918982.334607:0:7997:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd82800380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7997:1877914550295040:0@lo:5: 00000004:00080000:3.0:1790918982.334621:0:7997:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:2.0:1790918982.924385:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790918983.943237:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790918984.448215:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88d98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550295168:0@lo:13: 00000100:00100000:3.0:1790918984.448342:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790918984.448837:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550295168 00000100:00100000:0.0:1790918984.448851:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550295168 00000100:00100000:0.0:1790918984.448933:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790918984.448946:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88db4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550295168:12345-0@lo:13: 00002000:00000024:0.0:1790918984.448994:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790918984.449070:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88db4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550295168:12345-0@lo:13: Request processed in 127us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918984.449079:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1790918984.449215:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88be88d98e00 x1877914550295168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919000 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790918984.449238:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88d98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550295168:0@lo:13: 00000100:00080000:3.0:1790918984.449430:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790918984.959905:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790918985.992440:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790918987.009441:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790918987.019734:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877914550295424:0@lo:400: 00000100:00100000:1.0:1790918987.019915:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550295296:0@lo:400: 00000100:00100000:1.0:1790918987.019975:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918987.020037:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1877914550295808:0@lo:400: 00000100:00100000:1.0:1790918987.020066:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918987.020109:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550295296 00000100:00100000:1.0:1790918987.020118:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550295296 00000100:00100000:1.0:1790918987.020182:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1790918987.020193:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87165050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3305:x1877914550295296:12345-0@lo:400: 00000100:00100000:1.0:1790918987.020257:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87165050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3305:x1877914550295296:12345-0@lo:400: Request processed in 65us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918987.020265:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1790918987.020302:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550295808 00000100:00100000:1.0:1790918987.020307:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550295808 00000100:00100000:1.0:1790918987.020356:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790918987.020363:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877914550295808:12345-0@lo:400: 00000100:00100000:1.0:1790918987.020789:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877914550295808:12345-0@lo:400: Request processed in 425us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918987.020796:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790918987.020859:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550295296:0@lo:400: 00010000:00080000:1.0:1790918987.020874:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88be88db7800 x1877914550295808/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790918987.020920:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1877914550295808:0@lo:400: 00000100:00100000:3.0:1790918987.021494:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918987.021551:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550295936:0@lo:400: 00000100:00100000:3.0:1790918987.021588:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918987.021623:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1877914550295552:0@lo:400: 00000100:00100000:3.0:1790918987.021677:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918987.021696:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790918987.021703:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550295680:0@lo:400: 00000100:00100000:3.0:1790918987.021721:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790918987.021747:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790918987.021767:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550295424 00000100:00100000:3.0:1790918987.021781:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550295424 00000100:00100000:3.0:1790918987.021880:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550295552 00000100:00100000:3.0:1790918987.021884:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550295552 00000100:00100000:3.0:1790918987.021970:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790918987.021978:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88db7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877914550295424:12345-0@lo:400: 00000100:00100000:3.0:1790918987.022089:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88db7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877914550295424:12345-0@lo:400: Request processed in 111us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918987.022097:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790918987.022112:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790918987.022118:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88db7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877914550295552:12345-0@lo:400: 00000100:00100000:3.0:1790918987.022144:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88db7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877914550295552:12345-0@lo:400: Request processed in 26us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918987.022150:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790918987.022370:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550295936 00000100:00100000:3.0:1790918987.022374:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550295936 00000100:00100000:3.0:1790918987.022497:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550295680 00000100:00100000:3.0:1790918987.022501:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550295680 00000100:00100000:3.0:1790918987.022520:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790918987.022555:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88db5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1877914550295936:12345-0@lo:400: 00000100:00100000:3.0:1790918987.022590:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88db5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1877914550295936:12345-0@lo:400: Request processed in 64us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918987.022596:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790918987.022607:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790918987.022612:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88db7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550295680:12345-0@lo:400: 00000100:00100000:3.0:1790918987.022634:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88db7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550295680:12345-0@lo:400: Request processed in 23us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918987.022640:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1790918987.022672:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790918987.022682:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790918987.022685:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790918987.022713:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88be88db6300 x1877914550295424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790918987.022727:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877914550295424:0@lo:400: 00010000:00080000:3.0:1790918987.022738:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88be88db5500 x1877914550295936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790918987.022747:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550295936:0@lo:400: 00010000:00080000:3.0:1790918987.022774:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88be88db6680 x1877914550295680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790918987.022782:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550295680:0@lo:400: 00010000:00080000:3.0:1790918987.022791:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88be88db4700 x1877914550295552/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790918987.022799:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1877914550295552:0@lo:400: 00000100:00100000:3.0:1790918987.522622:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790918987.522666:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550296064:0@lo:13: 00000100:00100000:3.0:1790918987.522768:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790918987.522913:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550296064 00000100:00100000:0.0:1790918987.522924:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550296064 00000100:00100000:0.0:1790918987.523064:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790918987.523075:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88db6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1877914550296064:12345-0@lo:13: 00002000:00000024:0.0:1790918987.523137:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790918987.523270:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88db6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1877914550296064:12345-0@lo:13: Request processed in 196us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918987.523276:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1790918987.523863:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88be88db4700 x1877914550296064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919003 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790918987.523889:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550296064:0@lo:13: 00000001:00080000:2.0:1790918987.524368:0:7662:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1790918988.031984:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790918988.112343:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790918988.112502:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532446336 00000100:00100000:0.0:1790918988.112518:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532446336 00000100:00100000:0.0:1790918988.112596:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 113 00000100:00100000:0.0:1790918988.112607:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2349:x1877914532446336:12345-192.168.201.27@tcp:250: 00010000:00080000:0.0:1790918988.112655:0:5838:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 002ffd4e-702a-440d-a423-3e840d72bb2e@192.168.201.27@tcp t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:0.0:1790918988.112695:0:5838:0:(genops.c:1384:class_connect()) connect: client 002ffd4e-702a-440d-a423-3e840d72bb2e, cookie 0xc3296956897c41fe 00000100:00080000:0.0:1790918988.112890:0:5838:0:(import.c:65:import_set_state_nolock()) ffff88bebaa1e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790918988.112985:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+5:2349:x1877914532446336:12345-192.168.201.27@tcp:250: Request processed in 379us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918988.112995:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 113 00000100:00100000:3.0:1790918988.135072:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790918988.135127:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532446464 00000100:00100000:3.0:1790918988.135142:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532446464 00000100:00100000:3.0:1790918988.135209:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 114 00000100:00100000:3.0:1790918988.135221:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87164450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+5:5577:x1877914532446464:12345-192.168.201.27@tcp:101: 00010000:00010000:3.0:1790918988.135265:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790918988.135288:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be81517800/0xc3296956897c4205 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8b413717672ca92 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918988.135326:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be81517800/0xc3296956897c4205 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ca92 expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918988.135340:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be81517800/0xc3296956897c4205 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ca92 expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918988.135352:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81517800, rc 0) 00000100:00100000:3.0:1790918988.135441:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87164450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+6:5577:x1877914532446464:12345-192.168.201.27@tcp:101: Request processed in 221us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918988.135448:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 114 00000100:00100000:3.0:1790918988.143271:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790918988.144521:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532446592 00000100:00100000:2.0:1790918988.144555:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532446592 00000100:00100000:2.0:1790918988.144687:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 115 00000100:00100000:2.0:1790918988.144697:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87167c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+6:5577:x1877914532446592:12345-192.168.201.27@tcp:501: 00000100:00100000:2.0:1790918988.147063:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87167c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+6:5577:x1877914532446592:12345-192.168.201.27@tcp:501: Request processed in 1189us (2631us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790918988.147085:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 115 00000100:00100000:2.0:1790918988.158848:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790918988.160820:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532446720 00000100:00100000:3.0:1790918988.160842:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532446720 00000100:00100000:3.0:1790918988.161000:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 116 00000100:00100000:3.0:1790918988.161013:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be86bb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+6:5577:x1877914532446720:12345-192.168.201.27@tcp:101: 00010000:00010000:3.0:1790918988.161036:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790918988.161057:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be81517000/0xc3296956897c420c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8b413717672ca99 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918988.161093:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be81517000/0xc3296956897c420c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ca99 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918988.161106:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be81517000/0xc3296956897c420c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ca99 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918988.161129:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81517000, rc 0) 00000100:00100000:3.0:1790918988.161230:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be86bb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+7:5577:x1877914532446720:12345-192.168.201.27@tcp:101: Request processed in 220us (2397us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918988.161237:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 116 00000100:00100000:3.0:1790918988.166916:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790918988.167044:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532446848 00000100:00100000:0.0:1790918988.167056:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532446848 00000100:00100000:0.0:1790918988.167114:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 117 00000100:00100000:0.0:1790918988.167122:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be86bbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+7:5577:x1877914532446848:12345-192.168.201.27@tcp:501: 00000100:00100000:0.0:1790918988.167485:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be86bbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+8:5577:x1877914532446848:12345-192.168.201.27@tcp:501: Request processed in 362us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918988.167492:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 117 00000100:00100000:3.0:1790918988.171828:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790918988.171878:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532446976 00000100:00100000:1.0:1790918988.171952:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532446976 00000100:00100000:1.0:1790918988.172025:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 118 00000100:00100000:1.0:1790918988.172037:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be86bb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+8:5577:x1877914532446976:12345-192.168.201.27@tcp:503: 00000100:00100000:1.0:1790918988.172902:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be86bb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+8:5577:x1877914532446976:12345-192.168.201.27@tcp:503: Request processed in 852us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918988.172915:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 118 00000100:00100000:0.0:1790918988.192143:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790918988.192317:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532447104 00000100:00100000:1.0:1790918988.192331:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532447104 00000100:00100000:1.0:1790918988.192414:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 119 00000100:00100000:1.0:1790918988.192427:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be86bba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+8:5595:x1877914532447104:12345-192.168.201.27@tcp:502: 00000100:00100000:1.0:1790918988.193072:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be86bba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+8:5595:x1877914532447104:12345-192.168.201.27@tcp:502: Request processed in 642us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918988.193084:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 119 00000100:00100000:3.0:1790918988.223510:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790918988.223660:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532447232 00000100:00100000:0.0:1790918988.223683:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532447232 00000100:00100000:0.0:1790918988.223754:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 120 00000100:00100000:0.0:1790918988.223767:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be86bb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+8:5595:x1877914532447232:12345-192.168.201.27@tcp:502: 00000100:00100000:0.0:1790918988.224145:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be86bb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+8:5595:x1877914532447232:12345-192.168.201.27@tcp:502: Request processed in 373us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918988.224155:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 120 00000100:00100000:0.0:1790918988.230079:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790918988.233231:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532447360 00000100:00100000:1.0:1790918988.233256:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532447360 00000100:00100000:1.0:1790918988.233344:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 121 00000100:00100000:1.0:1790918988.233357:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be86bb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+8:5577:x1877914532447360:12345-192.168.201.27@tcp:101: 00010000:00010000:1.0:1790918988.233383:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790918988.233409:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be81673a00/0xc3296956897c4213 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8b413717672cac3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918988.233448:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be81673a00/0xc3296956897c4213 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cac3 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918988.233486:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be81673a00/0xc3296956897c4213 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cac3 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918988.233498:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81673a00, rc 0) 00000100:00100000:1.0:1790918988.233636:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be86bb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+9:5577:x1877914532447360:12345-192.168.201.27@tcp:101: Request processed in 281us (3571us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918988.233645:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 121 00000100:00100000:1.0:1790918988.237910:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790918988.238014:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532447488 00000100:00100000:3.0:1790918988.238028:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532447488 00000100:00100000:3.0:1790918988.238101:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 122 00000100:00100000:3.0:1790918988.238113:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be86bb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+9:5577:x1877914532447488:12345-192.168.201.27@tcp:256: 20000000:01000000:3.0:1790918988.238150:0:5840:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1790918988.238184:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1790918988.238188:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1790918988.238192:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1790918988.238194:0:5840:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1790918988.245911:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be86bb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+9:5577:x1877914532447488:12345-192.168.201.27@tcp:256: Request processed in 7774us (7991us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918988.245931:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 122 00000100:00100000:1.0:1790918988.252879:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790918988.253133:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532447616 00000100:00100000:2.0:1790918988.253147:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532447616 00000100:00100000:2.0:1790918988.253400:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 123 00000100:00100000:2.0:1790918988.253413:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be86bb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+9:5577:x1877914532447616:12345-192.168.201.27@tcp:101: 00010000:00010000:2.0:1790918988.253435:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790918988.253459:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be88387c00/0xc3296956897c421a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8b413717672caca expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918988.253496:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be88387c00/0xc3296956897c421a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672caca expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918988.253511:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be88387c00/0xc3296956897c421a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672caca expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918988.253570:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be88387c00, rc 0) 00000100:00100000:2.0:1790918988.253654:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be86bb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+10:5577:x1877914532447616:12345-192.168.201.27@tcp:101: Request processed in 243us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918988.253661:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 123 00000100:00100000:1.0:1790918988.267042:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790918988.267140:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532447744 00000100:00100000:3.0:1790918988.267154:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532447744 00000100:00100000:3.0:1790918988.267231:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 124 00000100:00100000:3.0:1790918988.267243:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be86bbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+10:5577:x1877914532447744:12345-192.168.201.27@tcp:501: 00000100:00100000:3.0:1790918988.267636:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be86bbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+10:5577:x1877914532447744:12345-192.168.201.27@tcp:501: Request processed in 393us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918988.267647:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 124 00000100:00100000:3.0:1790918988.270974:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790918988.271225:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532447872 00000100:00100000:2.0:1790918988.271240:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532447872 00000100:00100000:2.0:1790918988.271302:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 125 00000100:00100000:2.0:1790918988.271314:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be86bbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+10:5577:x1877914532447872:12345-192.168.201.27@tcp:503: 00000100:00100000:2.0:1790918988.272009:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be86bbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+10:5577:x1877914532447872:12345-192.168.201.27@tcp:503: Request processed in 692us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918988.272020:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 125 00000100:00100000:3.0:1790918988.288460:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790918988.288898:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532448000 00000100:00100000:0.0:1790918988.288913:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532448000 00000100:00100000:0.0:1790918988.288988:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 126 00000100:00100000:0.0:1790918988.289001:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be86bba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+10:5599:x1877914532448000:12345-192.168.201.27@tcp:502: 00000100:00100000:0.0:1790918988.289401:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be86bba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+10:5599:x1877914532448000:12345-192.168.201.27@tcp:502: Request processed in 401us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918988.289410:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 126 00000100:00100000:1.0:1790918988.295632:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790918988.295723:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532448128 00000100:00100000:3.0:1790918988.295751:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532448128 00000100:00100000:3.0:1790918988.295838:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 127 00000100:00100000:3.0:1790918988.295851:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be86bb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+10:5599:x1877914532448128:12345-192.168.201.27@tcp:502: 00000100:00100000:3.0:1790918988.296302:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be86bb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+10:5599:x1877914532448128:12345-192.168.201.27@tcp:502: Request processed in 449us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918988.296312:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 127 00000100:00100000:1.0:1790918988.314640:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790918988.314693:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532448256 00000100:00100000:1.0:1790918988.314707:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532448256 00000100:00100000:1.0:1790918988.315617:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 4 00000100:00100000:1.0:1790918988.315640:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2349:x1877914532448256:12345-192.168.201.27@tcp:38: 00010000:00080000:1.0:1790918988.315683:0:5847:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from c4a4e085-55d7-40e9-993c-11b4dfc2d5f5@192.168.201.27@tcp t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:1.0:1790918988.315748:0:5847:0:(genops.c:1384:class_connect()) connect: client c4a4e085-55d7-40e9-993c-11b4dfc2d5f5, cookie 0xc3296956897c4221 00000004:00100000:1.0:1790918988.316155:0:5847:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1790918988.316164:0:5847:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1790918988.368045:0:5847:0:(import.c:65:import_set_state_nolock()) ffff88bebaa18000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790918988.368159:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2349:x1877914532448256:12345-192.168.201.27@tcp:38: Request processed in 52517us (53542us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918988.368173:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 4 00010000:00010000:0.0:1790918989.055785:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790918989.383521:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790918989.383627:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790918989.385228:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532448384 00000100:00100000:1.0:1790918989.385248:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532448384 00000100:00100000:1.0:1790918989.385340:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532448512 00000100:00100000:1.0:1790918989.385344:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532448512 00000100:00100000:1.0:1790918989.385376:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 5 00000100:00100000:1.0:1790918989.385387:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88db4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:0:x1877914532448384:12345-192.168.201.27@tcp:41: 00000004:00000024:1.0:1790918989.385467:0:5845:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1790918989.385611:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88db4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:0:x1877914532448384:12345-192.168.201.27@tcp:41: Request processed in 216us (2096us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918989.385620:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 5 00000100:00100000:1.0:1790918989.385641:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 6 00000100:00100000:1.0:1790918989.385648:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88db5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:5577:x1877914532448512:12345-192.168.201.27@tcp:41: 00000004:00000024:1.0:1790918989.385658:0:5845:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1790918989.385676:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88db5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:5577:x1877914532448512:12345-192.168.201.27@tcp:41: Request processed in 30us (2050us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918989.385682:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 6 00000100:00080000:3.0:1790918989.386462:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790918989.397871:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790918989.398010:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532448640 00000100:00100000:3.0:1790918989.398024:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532448640 00000100:00100000:3.0:1790918989.398107:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 7 00000100:00100000:3.0:1790918989.398119:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:5577:x1877914532448640:12345-192.168.201.27@tcp:40: 00000100:00100000:3.0:1790918989.398249:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:5577:x1877914532448640:12345-192.168.201.27@tcp:40: Request processed in 131us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918989.398257:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 7 00000100:00100000:1.0:1790918989.410910:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790918989.410984:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790918989.411103:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532448768 00000100:00100000:2.0:1790918989.411118:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532448768 00000100:00100000:2.0:1790918989.411173:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532448896 00000100:00100000:2.0:1790918989.411177:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532448896 00000100:00100000:2.0:1790918989.411194:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 8 00000100:00100000:2.0:1790918989.411204:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2349:x1877914532448768:12345-192.168.201.27@tcp:8: 00010000:00080000:2.0:1790918989.411249:0:6700:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from c4a4e085-55d7-40e9-993c-11b4dfc2d5f5@192.168.201.27@tcp t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:2.0:1790918989.411290:0:6700:0:(genops.c:1384:class_connect()) connect: client c4a4e085-55d7-40e9-993c-11b4dfc2d5f5, cookie 0xc3296956897c4228 00002000:00100000:2.0:1790918989.411306:0:6700:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c4a4e085-55d7-40e9-993c-11b4dfc2d5f5/ffff88bd82856800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790918989.411337:0:6700:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790918989.411835:0:6700:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790918989.411879:0:6700:0:(import.c:65:import_set_state_nolock()) ffff88bd82851800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790918989.411974:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2349:x1877914532448768:12345-192.168.201.27@tcp:8: Request processed in 769us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918989.412000:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 8 00000100:00100000:2.0:1790918989.412027:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 9 00000100:00100000:2.0:1790918989.412032:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2349:x1877914532448896:12345-192.168.201.27@tcp:8: 00010000:00080000:2.0:1790918989.412053:0:6700:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from c4a4e085-55d7-40e9-993c-11b4dfc2d5f5@192.168.201.27@tcp t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:2.0:1790918989.412073:0:6700:0:(genops.c:1384:class_connect()) connect: client c4a4e085-55d7-40e9-993c-11b4dfc2d5f5, cookie 0xc3296956897c422f 00002000:00100000:2.0:1790918989.412080:0:6700:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c4a4e085-55d7-40e9-993c-11b4dfc2d5f5/ffff88bd82852000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790918989.412098:0:6700:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790918989.412330:0:6700:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790918989.412348:0:6700:0:(import.c:65:import_set_state_nolock()) ffff88bd82856000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790918989.412373:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2349:x1877914532448896:12345-192.168.201.27@tcp:8: Request processed in 340us (1389us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918989.412380:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 9 00000100:00100000:1.0:1790918989.413422:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790918989.413495:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790918989.413929:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532449152 00000100:00100000:2.0:1790918989.413941:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532449152 00000100:00100000:2.0:1790918989.413995:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 128 00000100:00100000:2.0:1790918989.414003:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88d03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+10:2351:x1877914532449152:12345-192.168.201.27@tcp:400: 00000100:00100000:2.0:1790918989.414073:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88d03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+10:2351:x1877914532449152:12345-192.168.201.27@tcp:400: Request processed in 71us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918989.414081:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 128 00000100:00100000:3.0:1790918989.414225:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532449024 00000100:00100000:3.0:1790918989.414230:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532449024 00000100:00100000:3.0:1790918989.414266:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 0 00000100:00100000:3.0:1790918989.414274:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:5577:x1877914532449024:12345-192.168.201.27@tcp:33: 00000004:00080000:3.0:1790918989.451085:0:5848:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 36722us 00000004:00200000:0.0:1790918989.513711:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1790918989.513881:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:5577:x1877914532449024:12345-192.168.201.27@tcp:33: Request processed in 99599us (100458us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918989.513899:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 0 00000100:00100000:1.0:1790918989.567965:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790918989.568004:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88d99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550296192:0@lo:13: 00000100:00100000:1.0:1790918989.568108:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918989.568640:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550296192 00000100:00100000:2.0:1790918989.568653:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550296192 00000100:00100000:2.0:1790918989.568742:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790918989.568755:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550296192:12345-0@lo:13: 00002000:00000024:2.0:1790918989.568784:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790918989.568874:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550296192:12345-0@lo:13: Request processed in 111us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918989.568882:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1790918989.569076:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790918989.569129:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88be88d99c00 x1877914550296192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919005 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790918989.569154:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88d99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550296192:0@lo:13: 00000100:00100000:1.0:1790918989.719933:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790918989.722870:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532449280 00000100:00100000:2.0:1790918989.722890:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532449280 00000100:00100000:2.0:1790918989.723004:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 8 00000100:00100000:2.0:1790918989.723017:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:5616:x1877914532449280:12345-192.168.201.27@tcp:101: 00010000:00010000:2.0:1790918989.723046:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790918989.723682:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387600/0xc3296956897c4236 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672caf4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918989.723764:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c423d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918989.723777:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c423d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918989.723794:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c423d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790918989.723829:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790918989.723833:0:5846:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790918989.723851:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c423d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918989.723877:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387600/0xc3296956897c4236 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672caf4 expref: 8 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918989.723914:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c423d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672caf4 expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918989.723923:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be85efc400) 00010000:00010000:2.0:1790918989.723926:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790918989.723929:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be88386e00, rc 0) 00000100:00100000:2.0:1790918989.724014:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:5616:x1877914532449280:12345-192.168.201.27@tcp:101: Request processed in 999us (4096us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918989.724023:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 8 00010000:00010000:3.0:1790918990.084660:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790918991.105747:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790918992.124281:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790918992.124510:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532449408 00000100:00100000:0.0:1790918992.124520:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532449408 00000100:00100000:0.0:1790918992.124633:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 9 00000100:00100000:0.0:1790918992.124644:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd82800a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:5668:x1877914532449408:12345-192.168.201.27@tcp:41: 00000004:00000024:0.0:1790918992.124689:0:5847:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1790918992.124765:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd82800a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:5668:x1877914532449408:12345-192.168.201.27@tcp:41: Request processed in 123us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918992.124774:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 9 00000100:00080000:1.0:1790918992.125883:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790918992.127588:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790918992.127879:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550296704:0@lo:400: 00000100:00100000:3.0:1790918992.127950:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918992.128005:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790918992.128011:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1877914550296576:0@lo:400: 00000100:00100000:3.0:1790918992.128046:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918992.128319:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550296320:0@lo:400: 00000100:00100000:2.0:1790918992.128336:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550296704 00000100:00100000:2.0:1790918992.128346:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550296704 00000100:00100000:1.0:1790918992.128354:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918992.128390:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1877914550296832:0@lo:400: 00000100:00100000:2.0:1790918992.128412:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790918992.128415:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918992.128438:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550296704:12345-0@lo:400: 00000100:00100000:1.0:1790918992.128439:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1790918992.128448:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877914550296448:0@lo:400: 00000100:00100000:1.0:1790918992.128468:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918992.128486:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550296960:0@lo:400: 00000100:00100000:2.0:1790918992.128514:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550296704:12345-0@lo:400: Request processed in 78us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918992.128522:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1790918992.128608:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88be88db7100 x1877914550296704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790918992.128623:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550296704:0@lo:400: 00000100:00100000:2.0:1790918992.128645:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532449536 00000100:00100000:2.0:1790918992.128649:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532449536 00000100:00100000:2.0:1790918992.128691:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 8 00000100:00100000:2.0:1790918992.128698:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:5668:x1877914532449536:12345-192.168.201.27@tcp:13: 00002000:00000024:2.0:1790918992.128729:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790918992.128737:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918992.128770:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550296960 00000100:00100000:1.0:1790918992.128774:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550296960 00000100:00100000:2.0:1790918992.128789:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:5668:x1877914532449536:12345-192.168.201.27@tcp:13: Request processed in 90us (1208us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918992.128797:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 8 00000100:00100000:1.0:1790918992.128862:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790918992.128872:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550296960:12345-0@lo:400: 00000100:00100000:1.0:1790918992.128915:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550296960:12345-0@lo:400: Request processed in 47us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918992.128919:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550296576 00000100:00100000:1.0:1790918992.128924:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790918992.128925:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550296576 00000100:00080000:1.0:1790918992.128949:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790918992.128953:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550296832 00000100:00080000:1.0:1790918992.128955:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790918992.128958:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550296832 00000100:00080000:1.0:1790918992.128959:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790918992.128971:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550296448 00000100:00100000:1.0:1790918992.128975:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550296448 00000100:00100000:2.0:1790918992.128989:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790918992.128997:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877914550296576:12345-0@lo:400: 00000100:00100000:3.0:1790918992.129034:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550296320 00000100:00100000:3.0:1790918992.129038:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550296320 00000100:00100000:2.0:1790918992.129043:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877914550296576:12345-0@lo:400: Request processed in 45us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918992.129124:0:5847:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1790918992.129133:0:5847:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_003' 00010000:00010000:0.0:1790918992.129253:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790918992.129293:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1790918992.129303:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88d03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3305:x1877914550296320:12345-0@lo:400: 00000100:00100000:3.0:1790918992.129335:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88d03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3305:x1877914550296320:12345-0@lo:400: Request processed in 36us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918992.129342:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1790918992.129393:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1877914550296576:0@lo:400: 00000100:00100000:1.0:1790918992.129449:0:5845:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1790918992.129458:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790918992.129464:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877914550296832:12345-0@lo:400: 00000100:00100000:1.0:1790918992.129493:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877914550296832:12345-0@lo:400: Request processed in 30us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918992.129498:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790918992.129508:0:5845:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1790918992.129514:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790918992.129763:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877914550296448:12345-0@lo:400: 00000100:00100000:1.0:1790918992.129792:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877914550296448:12345-0@lo:400: Request processed in 273us (1322us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918992.130413:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1790918992.130441:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790918992.131045:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88be88db4a80 x1877914550296960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790918992.131058:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1790918992.131080:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550296960:0@lo:400: 00000100:00100000:3.0:1790918992.131096:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550296320:0@lo:400: 00000100:00100000:3.0:1790918992.131127:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1877914550296832:0@lo:400: 00000100:00100000:3.0:1790918992.131150:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877914550296448:0@lo:400: 00000100:00100000:2.0:1790918992.131677:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790918992.139191:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790918992.139296:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532449664 00000100:00100000:0.0:1790918992.139307:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532449664 00000100:00080000:1.0:1790918992.139387:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790918992.139393:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 9 00000100:00100000:0.0:1790918992.139405:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd82801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:5668:x1877914532449664:12345-192.168.201.27@tcp:13: 00002000:00000024:0.0:1790918992.139456:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790918992.139569:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd82801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:5668:x1877914532449664:12345-192.168.201.27@tcp:13: Request processed in 123us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918992.139578:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 9 00000100:00100000:3.0:1790918992.639663:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790918992.639686:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550297088:0@lo:13: 00000100:00100000:3.0:1790918992.639746:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918992.639806:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550297088 00000100:00100000:3.0:1790918992.639814:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550297088 00000100:00100000:3.0:1790918992.639979:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790918992.639989:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550297088:12345-0@lo:13: 00002000:00000024:3.0:1790918992.640012:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790918992.640070:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550297088:12345-0@lo:13: Request processed in 83us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918992.640078:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1790918992.640125:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebf74dc00 x1877914550297088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919008 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790918992.640142:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550297088:0@lo:13: 00010000:00010000:3.0:1790918993.163445:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1790918993.735172:0:7662:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c4a4e085-55d7-40e9-993c-11b4dfc2d5f5 00000001:00100000:2.0:1790918993.736019:0:5869:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c4a4e085-55d7-40e9-993c-11b4dfc2d5f5 00010000:00010000:0.0:1790918994.175927:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790918994.281225:0:6722:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c4a4e085-55d7-40e9-993c-11b4dfc2d5f5 00000001:02000400:0.0:1790918994.606433:0:8320:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1790918994.644697:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790918994.644737:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790918994.644762:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790918994.644786:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790918994.644890:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532449792 00000100:00100000:3.0:1790918994.644901:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532449792 00000100:00100000:3.0:1790918994.644956:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 130 00000100:00100000:3.0:1790918994.644966:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88d02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+10:2350:x1877914532449792:12345-192.168.201.27@tcp:400: 00000100:00100000:3.0:1790918994.645038:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88d02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+10:2350:x1877914532449792:12345-192.168.201.27@tcp:400: Request processed in 73us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918994.645046:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 130 00000100:00100000:1.0:1790918994.645255:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532450048 00000100:00100000:1.0:1790918994.645260:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532450048 00000100:00100000:1.0:1790918994.645308:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532450176 00000100:00100000:1.0:1790918994.645312:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532450176 00000100:00100000:1.0:1790918994.645328:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 7 00000100:00100000:1.0:1790918994.645337:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88d98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2350:x1877914532450048:12345-192.168.201.27@tcp:400: 00000100:00100000:1.0:1790918994.645373:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88d98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2350:x1877914532450048:12345-192.168.201.27@tcp:400: Request processed in 39us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918994.645380:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 7 00000100:00100000:1.0:1790918994.645395:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 8 00000100:00100000:1.0:1790918994.645401:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88d99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2350:x1877914532450176:12345-192.168.201.27@tcp:400: 00000100:00100000:1.0:1790918994.645424:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88d99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2350:x1877914532450176:12345-192.168.201.27@tcp:400: Request processed in 23us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918994.645430:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 8 00000100:00100000:1.0:1790918994.645449:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532449920 00000100:00100000:1.0:1790918994.645452:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532449920 00000100:00100000:1.0:1790918994.645479:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 23 00000100:00100000:1.0:1790918994.645486:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2350:x1877914532449920:12345-192.168.201.27@tcp:400: 00000100:00100000:1.0:1790918994.645523:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2350:x1877914532449920:12345-192.168.201.27@tcp:400: Request processed in 38us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918994.645547:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 23 00000100:00080000:0.0:1790918994.645691:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790918994.645697:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790918994.645708:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790918994.690332:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790918994.690358:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb0b1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550297216:0@lo:13: 00000100:00100000:1.0:1790918994.690439:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918994.691332:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550297216 00000100:00100000:3.0:1790918994.691343:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550297216 00000100:00100000:3.0:1790918994.691416:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790918994.691426:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550297216:12345-0@lo:13: 00002000:00000024:3.0:1790918994.691460:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790918994.691548:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550297216:12345-0@lo:13: Request processed in 123us (1108us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918994.691555:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1790918994.691596:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88beb0b1ce00 x1877914550297216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919010 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790918994.691622:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb0b1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550297216:0@lo:13: 00000100:00080000:1.0:1790918994.691755:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790918995.200314:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790918996.227799:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790918997.247797:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790918997.252108:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb0b1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877914550297472:0@lo:400: 00000100:00100000:1.0:1790918997.252175:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790918997.252212:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb0b1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550297344:0@lo:400: 00000100:00100000:1.0:1790918997.252237:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb0b1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550297984:0@lo:400: 00000100:00100000:0.0:1790918997.252246:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918997.252260:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790918997.252268:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb0b1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1877914550297856:0@lo:400: 00000100:00100000:0.0:1790918997.252289:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918997.252291:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb0b1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1877914550297600:0@lo:400: 00000100:00100000:1.0:1790918997.252313:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790918997.252319:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550297472 00000100:00100000:0.0:1790918997.252325:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550297472 00000100:00100000:1.0:1790918997.252327:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790918997.252331:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb0b1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550297728:0@lo:400: 00000100:00100000:1.0:1790918997.252349:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790918997.252364:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550297856 00000100:00100000:0.0:1790918997.252367:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550297856 00000100:00100000:1.0:1790918997.252370:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550297984 00000100:00100000:1.0:1790918997.252372:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550297984 00000100:00100000:0.0:1790918997.252387:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550297600 00000100:00100000:0.0:1790918997.252389:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550297600 00000100:00100000:1.0:1790918997.252395:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550297728 00000100:00100000:1.0:1790918997.252397:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550297728 00000100:00100000:0.0:1790918997.252403:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790918997.252409:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790918997.252411:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877914550297472:12345-0@lo:400: 00000100:00100000:1.0:1790918997.252414:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550297984:12345-0@lo:400: 00000100:00100000:2.0:1790918997.252518:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790918997.252544:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88d99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877914550297856:12345-0@lo:400: 00000100:00100000:2.0:1790918997.252580:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88d99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877914550297856:12345-0@lo:400: Request processed in 54us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918997.252587:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790918997.252603:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790918997.252609:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877914550297600:12345-0@lo:400: 00000100:00100000:2.0:1790918997.252637:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877914550297600:12345-0@lo:400: Request processed in 28us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918997.252643:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790918997.252678:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb0b1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1877914550297600:0@lo:400: 00000100:00100000:2.0:1790918997.252719:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb0b1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1877914550297856:0@lo:400: 00000100:00100000:1.0:1790918997.252902:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550297984:12345-0@lo:400: Request processed in 486us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918997.252909:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790918997.252923:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790918997.252929:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550297728:12345-0@lo:400: 00000100:00100000:1.0:1790918997.252966:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550297728:12345-0@lo:400: Request processed in 38us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918997.252972:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1790918997.252994:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790918997.252998:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790918997.253006:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790918997.253062:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88beb0b1f480 x1877914550297728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790918997.253073:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb0b1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550297728:0@lo:400: 00000100:00100000:3.0:1790918997.253163:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550297344 00000100:00100000:3.0:1790918997.253168:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550297344 00000100:00100000:3.0:1790918997.253194:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1790918997.253214:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88d01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3305:x1877914550297344:12345-0@lo:400: 00000100:00100000:3.0:1790918997.253248:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88d01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3305:x1877914550297344:12345-0@lo:400: Request processed in 48us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918997.253255:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1790918997.253382:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb0b1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550297344:0@lo:400: 00000100:00100000:0.0:1790918997.254759:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877914550297472:12345-0@lo:400: Request processed in 2343us (2579us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918997.254770:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790918997.255628:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb0b1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877914550297472:0@lo:400: 00010000:00080000:1.0:1790918997.255646:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88beb0b1f800 x1877914550297984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790918997.255656:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb0b1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550297984:0@lo:400: 00000100:00100000:3.0:1790918997.761155:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb0b1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550298112:0@lo:13: 00000100:00100000:3.0:1790918997.761310:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918997.761813:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550298112 00000100:00100000:1.0:1790918997.761825:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550298112 00000100:00100000:1.0:1790918997.761927:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790918997.761940:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550298112:12345-0@lo:13: 00002000:00000024:1.0:1790918997.761988:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790918997.762058:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550298112:12345-0@lo:13: Request processed in 121us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918997.762065:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1790918997.762137:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88beb0b1f800 x1877914550298112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919013 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790918997.762158:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb0b1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550298112:0@lo:13: 00000020:00000080:1.0:1790918997.814566:0:8467:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc2bb88aa0 20000000:00000080:1.0:1790918997.814591:0:8467:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff88be86ba1800 uarg=0000000000000000 20000000:01000000:1.0:1790918997.814638:0:8467:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1790918997.814641:0:8467:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1790918997.814644:0:8467:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1790918997.814650:0:8467:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1790918997.814656:0:8467:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1790918997.814676:0:8467:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1790918997.814679:0:8467:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1790918997.814953:0:8467:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1790918997.814957:0:8467:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1790918997.815978:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1790918997.816568:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1790918997.816650:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1790918997.816692:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:2.0:1790918997.816710:0:8467:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1790918997.816713:0:8467:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1790918997.817435:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1790918997.818245:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1790918997.818301:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1790918997.818352:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1790918997.818364:0:8467:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1790918997.818365:0:8467:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1790918997.819305:0:8470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1790918997.819878:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1790918997.819921:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1790918997.819940:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1790918997.819950:0:8467:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1790918997.819952:0:8467:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1790918997.821173:0:8471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1790918997.821934:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1790918997.821990:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1790918997.822028:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:2.0:1790918997.822046:0:8467:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1790918997.822072:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88be88386400/0xc3296956897c4244 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918997.822094:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88be81516e00/0xc3296956897c4141 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c413a expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918997.822102:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88be81672400/0xc3296956897c416b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c4164 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918997.822121:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88be81673800/0xc3296956897c4195 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c418e expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918997.822129:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88be88386200/0xc3296956897c41a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c419c expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918997.822135:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88be88387000/0xc3296956897c41b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c41aa expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918997.822142:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88be88387400/0xc3296956897c41cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c41c6 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918997.822149:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88be81516c00/0xc3296956897c41f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c41f0 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918997.822159:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88be81517800/0xc3296956897c4205 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ca92 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918997.822167:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88be81517000/0xc3296956897c420c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ca99 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918997.822177:0:8467:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88be88386400/0xc3296956897c4244 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918997.822231:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88be81517000/0xc3296956897c420c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ca99 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918997.822250:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88be81517000/0xc3296956897c420c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ca99 expref: 9 pid: 5838 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790918997.822280:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd82800380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877914550298240:192.168.201.27@tcp:104: 00010000:00010000:2.0:1790918997.822428:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88be81517800/0xc3296956897c4205 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ca92 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918997.822438:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88be81517800/0xc3296956897c4205 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ca92 expref: 9 pid: 5839 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790918997.822447:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd82802300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877914550298368:192.168.201.27@tcp:104: 00010000:00010000:2.0:1790918997.822493:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88be81516c00/0xc3296956897c41f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3296956897c41f0 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918997.822501:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88be81516c00/0xc3296956897c41f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3296956897c41f0 expref: 18 pid: 5839 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790918997.822511:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd82801180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877914550298496:0@lo:104: 00000100:00100000:2.0:1790918997.824097:0:8467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790918997.824227:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88be88387400/0xc3296956897c41cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3296956897c41c6 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918997.824244:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88be88387400/0xc3296956897c41cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3296956897c41c6 expref: 18 pid: 5839 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790918997.824259:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd82800700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877914550298624:0@lo:104: 00000100:00100000:2.0:1790918997.824307:0:8467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790918997.824343:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88be88387000/0xc3296956897c41b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3296956897c41aa expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918997.824352:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88be88387000/0xc3296956897c41b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3296956897c41aa expref: 18 pid: 5839 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790918997.824377:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd82801500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877914550298752:0@lo:104: 00010000:00010000:2.0:1790918997.824405:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88be88386200/0xc3296956897c41a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3296956897c419c expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918997.824413:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88be88386200/0xc3296956897c41a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3296956897c419c expref: 18 pid: 5839 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790918997.824422:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd82803480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877914550298880:0@lo:104: 00010000:00010000:2.0:1790918997.824449:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88be81673800/0xc3296956897c4195 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3296956897c418e expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918997.824469:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88be81673800/0xc3296956897c4195 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3296956897c418e expref: 18 pid: 5840 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790918997.824477:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877914550299008:0@lo:104: 00010000:00010000:2.0:1790918997.824503:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88be81672400/0xc3296956897c416b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3296956897c4164 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918997.824511:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88be81672400/0xc3296956897c416b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3296956897c4164 expref: 18 pid: 5840 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790918997.824519:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877914550299136:0@lo:104: 00010000:00010000:2.0:1790918997.824594:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88be81516e00/0xc3296956897c4141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3296956897c413a expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918997.824601:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88be81516e00/0xc3296956897c4141 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3296956897c413a expref: 18 pid: 5839 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790918997.824622:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877914550299264:0@lo:104: 00000100:00100000:2.0:1790918997.824644:0:8467:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be88cb4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790918997.824741:0:5828:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1790918997.824763:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918997.824775:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918997.824783:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918997.824800:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918997.824808:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918997.824817:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550298496 00000100:00100000:1.0:1790918997.824828:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550298496 00000100:00100000:1.0:1790918997.824879:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550298624 00000100:00100000:1.0:1790918997.824883:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550298624 00000100:00100000:1.0:1790918997.824895:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550298752 00000100:00100000:1.0:1790918997.824897:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550298752 00000100:00100000:1.0:1790918997.824906:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550298880 00000100:00100000:1.0:1790918997.824907:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550298880 00000100:00100000:1.0:1790918997.824917:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550299008 00000100:00100000:1.0:1790918997.824919:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550299008 00000100:00100000:1.0:1790918997.824927:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550299136 00000100:00100000:1.0:1790918997.824929:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550299136 00000100:00100000:1.0:1790918997.824939:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550299264 00000100:00100000:1.0:1790918997.824942:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550299264 00000100:00100000:1.0:1790918997.824955:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790918997.824966:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd82800000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+9:8467:x1877914550298496:12345-0@lo:104: 00010000:00010000:1.0:1790918997.824981:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.127@tcp lock: ffff88be81516400/0xc3296956897c41f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c41f7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918997.825054:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790918997.825061:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd82800000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+9:8467:x1877914550298496:12345-0@lo:104: Request processed in 98us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918997.825069:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790918997.825091:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790918997.825098:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3f2e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+8:8467:x1877914550298624:12345-0@lo:104: 00010000:00010000:1.0:1790918997.825105:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.127@tcp lock: ffff88be81517400/0xc3296956897c41c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c41cd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918997.825138:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790918997.825150:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3f2e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+8:8467:x1877914550298624:12345-0@lo:104: Request processed in 53us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918997.825155:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790918997.825195:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790918997.825202:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+7:8467:x1877914550298752:12345-0@lo:104: 00010000:00010000:1.0:1790918997.825211:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.127@tcp lock: ffff88be88386a00/0xc3296956897c41aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c41b1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918997.825243:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1790918997.825248:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+7:8467:x1877914550298752:12345-0@lo:104: Request processed in 48us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918997.825253:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790918997.825266:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790918997.825272:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+6:8467:x1877914550298880:12345-0@lo:104: 00010000:00010000:1.0:1790918997.825280:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.127@tcp lock: ffff88be88386000/0xc3296956897c419c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c41a3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918997.825306:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1790918997.825310:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+6:8467:x1877914550298880:12345-0@lo:104: Request processed in 39us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918997.825315:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790918997.825328:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790918997.825333:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+5:8467:x1877914550299008:12345-0@lo:104: 00010000:00010000:1.0:1790918997.825341:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.127@tcp lock: ffff88bd81146200/0xc3296956897c418e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c4195 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918997.825367:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1790918997.825378:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+5:8467:x1877914550299008:12345-0@lo:104: Request processed in 45us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918997.825384:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790918997.825397:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790918997.825403:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+4:8467:x1877914550299136:12345-0@lo:104: 00010000:00010000:1.0:1790918997.825410:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.127@tcp lock: ffff88be81517600/0xc3296956897c4164 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c416b expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918997.825438:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1790918997.825442:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+4:8467:x1877914550299136:12345-0@lo:104: Request processed in 41us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918997.825447:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790918997.825472:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790918997.825478:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+3:8467:x1877914550299264:12345-0@lo:104: 00010000:00010000:1.0:1790918997.825487:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.127@tcp lock: ffff88be81517a00/0xc3296956897c413a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c4141 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918997.825513:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1790918997.825517:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+3:8467:x1877914550299264:12345-0@lo:104: Request processed in 40us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918997.825554:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1790918997.825764:0:7650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1790918997.825773:0:7650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff88be81516400/0xc3296956897c41f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c41f7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.825781:0:7650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81516400 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:3.0:1790918997.825786:0:7650:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff88be81516400/0xc3296956897c41f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3296956897c41f7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.825796:0:7650:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff88be81516400/0xc3296956897c41f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3296956897c41f7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790918997.825812:0:7650:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff88be81516400/0xc3296956897c41f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3296956897c41f7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790918997.825818:0:7650:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790918997.825860:0:7650:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff88be81516400/0xc3296956897c41f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c41f7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.825867:0:7650:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790918997.825891:0:7650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff88be81516400/0xc3296956897c41f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c41f7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.825899:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff88be81516400/0xc3296956897c41f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c41f7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.825915:0:7650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1790918997.825919:0:7650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff88be81517400/0xc3296956897c41c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c41cd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.825924:0:7650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81517400 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:3.0:1790918997.825927:0:7650:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff88be81517400/0xc3296956897c41c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3296956897c41cd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.825934:0:7650:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff88be81517400/0xc3296956897c41c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3296956897c41cd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790918997.825940:0:7650:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff88be81517400/0xc3296956897c41c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3296956897c41cd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790918997.825946:0:7650:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790918997.825968:0:7650:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff88be81517400/0xc3296956897c41c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c41cd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.825974:0:7650:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790918997.825990:0:7650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff88be81517400/0xc3296956897c41c6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c41cd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.825997:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff88be81517400/0xc3296956897c41c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c41cd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.826006:0:7650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1790918997.826010:0:7650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff88be88386a00/0xc3296956897c41aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c41b1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.826015:0:7650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386a00 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:3.0:1790918997.826018:0:7650:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff88be88386a00/0xc3296956897c41aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3296956897c41b1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.826025:0:7650:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff88be88386a00/0xc3296956897c41aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3296956897c41b1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790918997.826031:0:7650:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff88be88386a00/0xc3296956897c41aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3296956897c41b1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790918997.826036:0:7650:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790918997.826049:0:7650:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff88be88386a00/0xc3296956897c41aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c41b1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.826055:0:7650:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790918997.826060:0:7650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff88be88386a00/0xc3296956897c41aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c41b1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.826076:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff88be88386a00/0xc3296956897c41aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c41b1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.826086:0:7650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1790918997.826089:0:7650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff88be88386000/0xc3296956897c419c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c41a3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.826094:0:7650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386000 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:3.0:1790918997.826097:0:7650:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff88be88386000/0xc3296956897c419c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3296956897c41a3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.826104:0:7650:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff88be88386000/0xc3296956897c419c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3296956897c41a3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790918997.826110:0:7650:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff88be88386000/0xc3296956897c419c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3296956897c41a3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790918997.826116:0:7650:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790918997.826131:0:7650:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff88be88386000/0xc3296956897c419c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c41a3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.826137:0:7650:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790918997.826142:0:7650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff88be88386000/0xc3296956897c419c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c41a3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.826148:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff88be88386000/0xc3296956897c419c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c41a3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.826157:0:7650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1790918997.826166:0:7650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff88bd81146200/0xc3296956897c418e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c4195 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.826172:0:7650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bd81146200 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:3.0:1790918997.826175:0:7650:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff88bd81146200/0xc3296956897c418e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3296956897c4195 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.826182:0:7650:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff88bd81146200/0xc3296956897c418e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3296956897c4195 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790918997.826188:0:7650:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff88bd81146200/0xc3296956897c418e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3296956897c4195 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790918997.826194:0:7650:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790918997.826208:0:7650:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff88bd81146200/0xc3296956897c418e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c4195 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.826215:0:7650:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790918997.826219:0:7650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff88bd81146200/0xc3296956897c418e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c4195 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.826225:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff88bd81146200/0xc3296956897c418e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c4195 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.826234:0:7650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790918997.826238:0:7650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff88be81517600/0xc3296956897c4164 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c416b expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.826243:0:7650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81517600 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:3.0:1790918997.826246:0:7650:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff88be81517600/0xc3296956897c4164 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3296956897c416b expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.826263:0:7650:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff88be81517600/0xc3296956897c4164 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3296956897c416b expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790918997.826270:0:7650:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff88be81517600/0xc3296956897c4164 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3296956897c416b expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790918997.826275:0:7650:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790918997.826289:0:7650:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff88be81517600/0xc3296956897c4164 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c416b expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.826294:0:7650:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790918997.826298:0:7650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff88be81517600/0xc3296956897c4164 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c416b expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.826305:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff88be81517600/0xc3296956897c4164 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c416b expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.826314:0:7650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790918997.826317:0:7650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff88be81517a00/0xc3296956897c413a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c4141 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.826323:0:7650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81517a00 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:3.0:1790918997.826325:0:7650:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff88be81517a00/0xc3296956897c413a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3296956897c4141 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.826333:0:7650:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff88be81517a00/0xc3296956897c413a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3296956897c4141 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790918997.826339:0:7650:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff88be81517a00/0xc3296956897c413a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3296956897c4141 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790918997.826350:0:7650:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790918997.826363:0:7650:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff88be81517a00/0xc3296956897c413a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c4141 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.826369:0:7650:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790918997.826373:0:7650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff88be81517a00/0xc3296956897c413a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c4141 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.826379:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff88be81517a00/0xc3296956897c413a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c4141 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.826394:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790918997.826396:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790918997.826398:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790918997.826441:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3308:1877914550299392:0@lo:103: 00000100:00100000:3.0:1790918997.826506:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918997.826580:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3308:1877914550299904:0@lo:103: 00000100:00100000:3.0:1790918997.826604:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918997.826628:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790918997.826634:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3308:1877914550299776:0@lo:103: 00000100:00100000:3.0:1790918997.826654:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918997.826684:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550299520:0@lo:103: 00000100:00100000:3.0:1790918997.826705:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918997.826714:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550300032:0@lo:103: 00000100:00100000:3.0:1790918997.826733:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918997.826746:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1790918997.826751:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550299648:0@lo:103: 00000100:00100000:3.0:1790918997.826780:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918997.826791:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550300160:0@lo:103: 00000100:00100000:3.0:1790918997.826813:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918997.826849:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550299392 00000100:00100000:3.0:1790918997.826857:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550299392 00010000:00010000:3.0:1790918997.826889:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88be81516c00/0xc3296956897c41f7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c41f0 expref: 19 pid: 5839 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790918997.826906:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550299904 00000100:00100000:3.0:1790918997.826908:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550299904 00010000:00010000:3.0:1790918997.826915:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88be81673800/0xc3296956897c4195 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c418e expref: 20 pid: 5840 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790918997.826921:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550299776 00000100:00100000:3.0:1790918997.826922:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550299776 00010000:00010000:3.0:1790918997.826928:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88be88386200/0xc3296956897c41a3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c419c expref: 21 pid: 5839 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790918997.826934:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550299520 00000100:00100000:3.0:1790918997.826935:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550299520 00010000:00010000:3.0:1790918997.826941:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88be88387400/0xc3296956897c41cd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c41c6 expref: 22 pid: 5839 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790918997.826946:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550300032 00000100:00100000:3.0:1790918997.826947:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550300032 00010000:00010000:3.0:1790918997.826954:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88be81672400/0xc3296956897c416b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c4164 expref: 23 pid: 5840 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790918997.826963:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550299648 00000100:00100000:3.0:1790918997.826965:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550299648 00010000:00010000:3.0:1790918997.826974:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88be88387000/0xc3296956897c41b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c41aa expref: 24 pid: 5839 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790918997.826996:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550300160 00000100:00100000:3.0:1790918997.826999:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550300160 00010000:00010000:3.0:1790918997.827014:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88be81516e00/0xc3296956897c4141 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c413a expref: 25 pid: 5839 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790918997.827027:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790918997.827034:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+25:3308:x1877914550299392:12345-0@lo:103: 00010000:00010000:3.0:1790918997.827046:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790918997.827050:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88be81516c00/0xc3296956897c41f7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c41f0 expref: 25 pid: 5839 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.827057:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88be81516c00/0xc3296956897c41f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3296956897c41f0 expref: 25 pid: 5839 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.827074:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790918997.827099:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+25:3308:x1877914550299392:12345-0@lo:103: Request processed in 66us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918997.827104:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790918997.827120:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790918997.827125:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+24:3308:x1877914550299904:12345-0@lo:103: 00010000:00010000:3.0:1790918997.827132:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790918997.827136:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88be81673800/0xc3296956897c4195 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c418e expref: 24 pid: 5840 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.827144:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88be81673800/0xc3296956897c4195 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3296956897c418e expref: 24 pid: 5840 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.827152:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790918997.827178:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+24:3308:x1877914550299904:12345-0@lo:103: Request processed in 53us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918997.827182:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790918997.827195:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790918997.827200:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+23:3308:x1877914550299776:12345-0@lo:103: 00010000:00010000:3.0:1790918997.827208:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790918997.827213:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88be88386200/0xc3296956897c41a3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c419c expref: 23 pid: 5839 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.827221:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88be88386200/0xc3296956897c41a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3296956897c419c expref: 23 pid: 5839 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.827231:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790918997.827251:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+23:3308:x1877914550299776:12345-0@lo:103: Request processed in 50us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918997.827257:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790918997.827269:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790918997.827275:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+22:3305:x1877914550299520:12345-0@lo:103: 00010000:00010000:3.0:1790918997.827283:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790918997.827286:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88be88387400/0xc3296956897c41cd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c41c6 expref: 22 pid: 5839 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.827291:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88be88387400/0xc3296956897c41cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3296956897c41c6 expref: 22 pid: 5839 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.827298:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790918997.827316:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+22:3305:x1877914550299520:12345-0@lo:103: Request processed in 43us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918997.827320:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790918997.827333:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790918997.827337:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+21:3305:x1877914550300032:12345-0@lo:103: 00010000:00010000:3.0:1790918997.827343:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790918997.827346:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88be81672400/0xc3296956897c416b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c4164 expref: 21 pid: 5840 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.827351:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88be81672400/0xc3296956897c416b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3296956897c4164 expref: 21 pid: 5840 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.827357:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790918997.827371:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+21:3305:x1877914550300032:12345-0@lo:103: Request processed in 33us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918997.827374:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790918997.827381:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790918997.827385:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+20:3305:x1877914550299648:12345-0@lo:103: 00010000:00010000:3.0:1790918997.827390:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790918997.827393:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88be88387000/0xc3296956897c41b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c41aa expref: 20 pid: 5839 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.827398:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88be88387000/0xc3296956897c41b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3296956897c41aa expref: 20 pid: 5839 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.827403:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790918997.827415:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+20:3305:x1877914550299648:12345-0@lo:103: Request processed in 30us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918997.827421:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790918997.827431:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790918997.827436:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be91cac050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3305:x1877914550300160:12345-0@lo:103: 00010000:00010000:3.0:1790918997.827444:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790918997.827467:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88be81516e00/0xc3296956897c4141 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c413a expref: 19 pid: 5839 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.827477:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88be81516e00/0xc3296956897c4141 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3296956897c413a expref: 19 pid: 5839 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.827486:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790918997.827508:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be91cac050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3305:x1877914550300160:12345-0@lo:103: Request processed in 71us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918997.827514:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790918997.827611:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550299648:0@lo:103: 00000100:00100000:3.0:1790918997.827619:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550300160:0@lo:103: 00000100:00100000:3.0:1790918997.827624:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550299520:0@lo:103: 00000100:00100000:3.0:1790918997.827629:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550300032:0@lo:103: 00000100:00100000:3.0:1790918997.827655:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3308:1877914550299776:0@lo:103: 00000100:00100000:3.0:1790918997.827660:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3308:1877914550299392:0@lo:103: 00000100:00100000:3.0:1790918997.827664:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3308:1877914550299904:0@lo:103: 00010000:00010000:2.0:1790918997.827823:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be81516c00/0xc3296956897c41f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3296956897c41f0 expref: 18 pid: 5839 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790918997.827834:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd82801180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877914550298496:0@lo:104: 00010000:00010000:2.0:1790918997.827841:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be88387400/0xc3296956897c41cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3296956897c41c6 expref: 17 pid: 5839 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790918997.827846:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd82800700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877914550298624:0@lo:104: 00010000:00010000:2.0:1790918997.827852:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be88387000/0xc3296956897c41b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3296956897c41aa expref: 16 pid: 5839 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790918997.827857:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd82801500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877914550298752:0@lo:104: 00010000:00010000:2.0:1790918997.827862:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be88386200/0xc3296956897c41a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3296956897c419c expref: 15 pid: 5839 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790918997.827867:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd82803480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877914550298880:0@lo:104: 00010000:00010000:2.0:1790918997.827872:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be81673800/0xc3296956897c4195 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3296956897c418e expref: 14 pid: 5840 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790918997.827878:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877914550299008:0@lo:104: 00010000:00010000:2.0:1790918997.827884:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be81672400/0xc3296956897c416b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3296956897c4164 expref: 13 pid: 5840 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790918997.827890:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877914550299136:0@lo:104: 00010000:00010000:2.0:1790918997.827895:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be81516e00/0xc3296956897c4141 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3296956897c413a expref: 12 pid: 5839 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790918997.827906:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877914550299264:0@lo:104: 00010000:00010000:0.0:1790918997.828158:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790918997.828167:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790918997.837864:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd82800380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877914550298240:192.168.201.27@tcp:104: 00000100:00100000:2.0:1790918997.837927:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd82802300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1877914550298368:192.168.201.27@tcp:104: 00010000:00010000:2.0:1790918997.838000:0:8467:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88be88386400/0xc3296956897c4244 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790918997.839065:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790918997.839352:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532450304 00000100:00100000:3.0:1790918997.839364:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532450304 00010000:00010000:3.0:1790918997.839417:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88be81517800/0xc3296956897c4205 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ca92 expref: 10 pid: 5839 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790918997.839471:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 19 00000100:00100000:3.0:1790918997.839482:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:002ffd4e-702a-440d-a423-3e840d72bb2e+10:2352:x1877914532450304:12345-192.168.201.27@tcp:103: 00010000:00010000:3.0:1790918997.839502:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790918997.839799:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88be81517800/0xc3296956897c4205 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ca92 expref: 10 pid: 5839 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.839813:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88be81517800/0xc3296956897c4205 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ca92 expref: 10 pid: 5839 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.839836:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be81517800/0xc3296956897c4205 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ca92 expref: 10 pid: 5839 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918997.839853:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790918997.839989:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:002ffd4e-702a-440d-a423-3e840d72bb2e+9:2352:x1877914532450304:12345-192.168.201.27@tcp:103: Request processed in 508us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918997.839998:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 19 00000100:00100000:3.0:1790918997.842059:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790918997.842101:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790918997.842156:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532450432 00000100:00100000:0.0:1790918997.842174:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532450432 00000100:00100000:0.0:1790918997.842247:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 132 00000100:00100000:0.0:1790918997.842259:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+9:5591:x1877914532450432:12345-192.168.201.27@tcp:101: 00010000:00010000:0.0:1790918997.842291:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790918997.842320:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88bd81146200/0xc3296956897c424b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8b413717672cafb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918997.842378:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88be88386400/0xc3296956897c4244 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918997.842390:0:5838:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88bd81146200/0xc3296956897c424b lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cafb expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918997.842414:0:5838:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: MGS lock: ffff88be88386400/0xc3296956897c4244 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918997.842431:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88bd81146200/0xc3296956897c424b lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cafb expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918997.842441:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bd81146200, rc 0) 00000100:00100000:0.0:1790918997.842568:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+10:5591:x1877914532450432:12345-192.168.201.27@tcp:101: Request processed in 310us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918997.842576:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 132 00000100:00100000:1.0:1790918997.842988:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532450560 00000100:00100000:1.0:1790918997.842995:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532450560 00010000:00010000:1.0:1790918997.843027:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88be81517000/0xc3296956897c420c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ca99 expref: 10 pid: 5838 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790918997.843067:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 20 00000100:00100000:1.0:1790918997.843085:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:002ffd4e-702a-440d-a423-3e840d72bb2e+10:2351:x1877914532450560:12345-192.168.201.27@tcp:103: 00010000:00010000:1.0:1790918997.843099:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790918997.843116:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88be81517000/0xc3296956897c420c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ca99 expref: 10 pid: 5838 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918997.843129:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88be81517000/0xc3296956897c420c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ca99 expref: 10 pid: 5838 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918997.843147:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be81517000/0xc3296956897c420c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ca99 expref: 10 pid: 5838 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918997.843165:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88be88386400/0xc3296956897c4244 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918997.843174:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be88386400/0xc3296956897c4244 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918997.843191:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88be88386400/0xc3296956897c4244 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918997.843199:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88be88386400/0xc3296956897c4244 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918997.843206:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88be88386400/0xc3296956897c4244 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918997.843214:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88be88386400/0xc3296956897c4244 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918997.843221:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386400 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:1.0:1790918997.843224:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88be88386400/0xc3296956897c4244 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918997.843240:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88be88386400/0xc3296956897c4244 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000020 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918997.843263:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88bd81146200/0xc3296956897c424b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cafb expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918997.843271:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88bd81146200/0xc3296956897c424b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cafb expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918997.843414:0:8467:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88be88386400/0xc3296956897c4244 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918997.843425:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88be88386400/0xc3296956897c4244 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918997.844732:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: MGS lock: ffff88bd81146200/0xc3296956897c424b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cafb expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790918997.844758:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb0b1f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:MGS:5830:1877914550300288:192.168.201.27@tcp:105: 00000100:00100000:1.0:1790918997.844875:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be86b02cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790918997.866472:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790918997.866517:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb0b1f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:MGS:5830:1877914550300288:192.168.201.27@tcp:105: 00000100:00100000:0.0:1790918997.866622:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532450688 00000100:00100000:0.0:1790918997.866633:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532450688 00000100:00100000:0.0:1790918997.866686:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 133 00000100:00100000:0.0:1790918997.866695:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+10:5591:x1877914532450688:12345-192.168.201.27@tcp:501: 00010000:00010000:1.0:1790918997.866755:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88be88386400/0xc3296956897c4244 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918997.866777:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be88386400/0xc3296956897c4244 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918997.866794:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790918997.866884:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:002ffd4e-702a-440d-a423-3e840d72bb2e+10:2351:x1877914532450560:12345-192.168.201.27@tcp:103: Request processed in 23796us (24777us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918997.866897:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 20 00000100:00100000:0.0:1790918997.867005:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+9:5591:x1877914532450688:12345-192.168.201.27@tcp:501: Request processed in 309us (553us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790918997.867014:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 133 00010000:00010000:3.0:1790918998.271870:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790918999.121097:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790918999.121243:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532450816 00000100:00100000:3.0:1790918999.121253:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532450816 00000100:00100000:3.0:1790918999.121307:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 134 00000100:00100000:3.0:1790918999.121317:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+9:5591:x1877914532450816:12345-192.168.201.27@tcp:101: 00010000:00010000:3.0:1790918999.121332:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790918999.121349:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be81517800/0xc3296956897c4252 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8b413717672cb02 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918999.121377:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be81517800/0xc3296956897c4252 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb02 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918999.121388:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be81517800/0xc3296956897c4252 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb02 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918999.121420:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81517800, rc 0) 00000100:00100000:3.0:1790918999.121500:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+10:5591:x1877914532450816:12345-192.168.201.27@tcp:101: Request processed in 184us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918999.121507:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 134 00000100:00100000:1.0:1790918999.132004:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790918999.132169:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532450944 00000100:00100000:0.0:1790918999.132179:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532450944 00000100:00100000:0.0:1790918999.132241:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 135 00000100:00100000:0.0:1790918999.132265:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+10:5591:x1877914532450944:12345-192.168.201.27@tcp:501: 00000100:00100000:0.0:1790918999.132588:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+10:5591:x1877914532450944:12345-192.168.201.27@tcp:501: Request processed in 324us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918999.132597:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 135 00000100:00100000:2.0:1790918999.136603:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790918999.136686:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532451072 00000100:00100000:3.0:1790918999.136694:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532451072 00000100:00100000:3.0:1790918999.136746:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 136 00000100:00100000:3.0:1790918999.136754:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+10:5591:x1877914532451072:12345-192.168.201.27@tcp:503: 00000100:00100000:3.0:1790918999.136958:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+10:5591:x1877914532451072:12345-192.168.201.27@tcp:503: Request processed in 204us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918999.136966:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 136 00000100:00100000:1.0:1790918999.140704:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790918999.140935:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532451200 00000100:00100000:2.0:1790918999.140945:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532451200 00000100:00100000:2.0:1790918999.141000:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 137 00000100:00100000:2.0:1790918999.141010:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+10:6063:x1877914532451200:12345-192.168.201.27@tcp:502: 00000100:00100000:2.0:1790918999.141513:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+10:6063:x1877914532451200:12345-192.168.201.27@tcp:502: Request processed in 503us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918999.141520:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 137 00000100:00100000:2.0:1790918999.145034:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790918999.145188:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532451328 00000100:00100000:1.0:1790918999.145212:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532451328 00000100:00100000:1.0:1790918999.145300:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 138 00000100:00100000:1.0:1790918999.145311:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+10:6063:x1877914532451328:12345-192.168.201.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790918999.145620:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+10:6063:x1877914532451328:12345-192.168.201.27@tcp:502:llog_process_th.0 Request processed in 310us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918999.145628:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 138 00010000:00010000:0.0:1790918999.296009:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790918999.679671:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1790918999.679681:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88bebf8da800 from 39 10000000:01000000:3.0:1790918999.679687:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790918999.679735:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be81517a00/0xc3296956897c4259 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918999.679748:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88be81517a00/0xc3296956897c4259 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918999.679759:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88be81517a00/0xc3296956897c4259 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790918999.679783:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550300416:0@lo:101: 00000100:00100000:3.0:1790918999.679854:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918999.680001:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550300416 00000100:00100000:2.0:1790918999.680010:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550300416 00000100:00100000:2.0:1790918999.680057:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1790918999.680066:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+12:5842:x1877914550300416:12345-0@lo:101: 00010000:00010000:2.0:1790918999.680079:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790918999.680105:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be88386800/0xc3296956897c4260 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c4259 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918999.680127:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be88386800/0xc3296956897c4260 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c4259 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918999.680137:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be88386800/0xc3296956897c4260 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c4259 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918999.680146:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be88386800, rc 0) 00000100:00100000:2.0:1790918999.680183:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:5842:x1877914550300416:12345-0@lo:101: Request processed in 118us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918999.680189:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1790918999.680220:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb44eb540 going to sleep for 11 seconds 00000100:00100000:3.0:1790918999.680241:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550300416:0@lo:101: 00010000:00010000:3.0:1790918999.680263:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88be81517a00/0xc3296956897c4259 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c4260 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918999.680272:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88be81517a00/0xc3296956897c4259 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c4260 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790918999.680316:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550300544:0@lo:501: 00000100:00100000:3.0:1790918999.680340:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918999.680354:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb44eb540 going to sleep for 11 seconds 00000100:00100000:1.0:1790918999.680418:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550300544 00000100:00100000:1.0:1790918999.680451:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550300544 00000100:00100000:1.0:1790918999.680483:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1790918999.680490:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:5842:x1877914550300544:12345-0@lo:501: 00000100:00100000:1.0:1790918999.680773:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:5842:x1877914550300544:12345-0@lo:501: Request processed in 282us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918999.680780:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1790918999.682046:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550300544:0@lo:501: 00000100:00100000:3.0:1790918999.682092:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550300672:0@lo:503: 00000100:00100000:3.0:1790918999.682143:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918999.682217:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550300672 00000100:00100000:2.0:1790918999.682223:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550300672 00000100:00100000:2.0:1790918999.682266:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1790918999.682274:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:5842:x1877914550300672:12345-0@lo:503: 00000100:00100000:2.0:1790918999.682440:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:5842:x1877914550300672:12345-0@lo:503: Request processed in 166us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918999.682447:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1790918999.685748:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb44eb540 going to sleep for 11 seconds 00000100:00100000:3.0:1790918999.685790:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550300672:0@lo:503: 00000100:00100000:3.0:1790918999.686825:0:8485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:8485:1877914550300800:0@lo:502: 00000100:00100000:3.0:1790918999.686895:0:8485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918999.686929:0:8485:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb44eb240 going to sleep for 11 seconds 00000100:00100000:2.0:1790918999.686994:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550300800 00000100:00100000:2.0:1790918999.687001:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550300800 00000100:00100000:2.0:1790918999.687047:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1790918999.687056:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:8485:x1877914550300800:12345-0@lo:502: 00000100:00100000:2.0:1790918999.687304:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:8485:x1877914550300800:12345-0@lo:502: Request processed in 248us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918999.687313:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1790918999.687451:0:8485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:8485:1877914550300800:0@lo:502: 00000100:00100000:3.0:1790918999.687489:0:8485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:8485:1877914550300928:0@lo:502: 00000100:00100000:3.0:1790918999.687521:0:8485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918999.687572:0:8485:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb44eb240 going to sleep for 11 seconds 00000100:00100000:0.0:1790918999.687624:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550300928 00000100:00100000:0.0:1790918999.687629:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550300928 00000100:00100000:0.0:1790918999.687661:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1790918999.687668:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:8485:x1877914550300928:12345-0@lo:502: 00000100:00100000:0.0:1790918999.687810:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:8485:x1877914550300928:12345-0@lo:502: Request processed in 142us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918999.687817:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1790918999.687893:0:8485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:8485:1877914550300928:0@lo:502: 00000040:00080000:3.0:1790918999.687911:0:8485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1790918999.688047:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1790918999.688064:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790918999.688073:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be81517a00/0xc3296956897c4259 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c4260 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918999.688085:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88be81517a00/0xc3296956897c4259 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c4260 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790918999.688094:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1790918999.688097:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1790918999.688100:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1790918999.688122:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88bd81147400/0xc3296956897c4267 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918999.688130:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88bd81147400/0xc3296956897c4267 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918999.688152:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88bd81147400/0xc3296956897c4267 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790918999.688165:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88d99c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550301056:0@lo:101: 00000100:00100000:0.0:1790918999.688193:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790918999.688214:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be86a73a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790918999.688264:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550301056 00000100:00100000:1.0:1790918999.688269:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550301056 00000100:00100000:1.0:1790918999.688299:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1790918999.688305:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+13:5842:x1877914550301056:12345-0@lo:101: 00010000:00010000:1.0:1790918999.688313:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790918999.688326:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be81672600/0xc3296956897c426e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c4267 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918999.688346:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be81672600/0xc3296956897c426e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c4267 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918999.688356:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be81672600/0xc3296956897c426e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c4267 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918999.688363:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81672600, rc 0) 00000100:00100000:1.0:1790918999.688407:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+14:5842:x1877914550301056:12345-0@lo:101: Request processed in 102us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918999.688413:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1790918999.688486:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88d99c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550301056:0@lo:101: 00010000:00010000:3.0:1790918999.688507:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88bd81147400/0xc3296956897c4267 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c426e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918999.688516:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88bd81147400/0xc3296956897c4267 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c426e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790918999.688599:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550301184:0@lo:501: 00000100:00100000:3.0:1790918999.688624:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918999.688645:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb44eb240 going to sleep for 11 seconds 00000100:00100000:3.0:1790918999.688655:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550301184 00000100:00100000:3.0:1790918999.688658:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550301184 00000100:00100000:3.0:1790918999.688674:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1790918999.688679:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+14:5842:x1877914550301184:12345-0@lo:501: 00000100:00100000:3.0:1790918999.688888:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+14:5842:x1877914550301184:12345-0@lo:501: Request processed in 208us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918999.688895:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1790918999.688922:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550301184:0@lo:501: 00000100:00100000:3.0:1790918999.688944:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550301312:0@lo:503: 00000100:00100000:3.0:1790918999.688976:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918999.688988:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb44eb240 going to sleep for 11 seconds 00000100:00100000:3.0:1790918999.688998:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550301312 00000100:00100000:3.0:1790918999.689001:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550301312 00000100:00100000:3.0:1790918999.689016:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1790918999.689022:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+14:5842:x1877914550301312:12345-0@lo:503: 00000100:00100000:3.0:1790918999.689149:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+14:5842:x1877914550301312:12345-0@lo:503: Request processed in 126us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918999.689156:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1790918999.689203:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550301312:0@lo:503: 00000100:00100000:3.0:1790918999.689356:0:8486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:8486:1877914550301440:0@lo:502: 00000100:00100000:3.0:1790918999.689386:0:8486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918999.689403:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550301440 00000100:00100000:3.0:1790918999.689407:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550301440 00000100:00100000:3.0:1790918999.689437:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1790918999.689444:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+14:8486:x1877914550301440:12345-0@lo:502: 00000100:00100000:3.0:1790918999.689584:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+14:8486:x1877914550301440:12345-0@lo:502: Request processed in 141us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918999.689591:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1790918999.689623:0:8486:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb44eb0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790918999.689635:0:8486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:8486:1877914550301440:0@lo:502: 00000020:01000000:3.0:1790918999.689654:0:8486:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790918999.689662:0:8486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790918999.689664:0:8486:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1790918999.689670:0:8486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1790918999.689689:0:8486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:8486:1877914550301568:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790918999.689719:0:8486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918999.689736:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550301568 00000100:00100000:3.0:1790918999.689739:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550301568 00000100:00100000:3.0:1790918999.689754:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1790918999.689759:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+14:8486:x1877914550301568:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790918999.689854:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+14:8486:x1877914550301568:12345-0@lo:502:llog_process_th.0 Request processed in 93us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918999.689860:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1790918999.689887:0:8486:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be8e2c6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790918999.689904:0:8486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:8486:1877914550301568:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790918999.689921:0:8486:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790918999.689925:0:8486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790918999.689927:0:8486:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1790918999.689931:0:8486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1790918999.689965:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1790918999.689978:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1790918999.689986:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88bd81147400/0xc3296956897c4267 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c426e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918999.689996:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88bd81147400/0xc3296956897c4267 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c426e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790918999.690004:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1790918999.690007:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88be86b70000 from 39 10000000:01000000:3.0:1790918999.690009:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790918999.690028:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be81517600/0xc3296956897c4275 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918999.690035:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88be81517600/0xc3296956897c4275 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918999.690045:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88be81517600/0xc3296956897c4275 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790918999.690057:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550301696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790918999.690081:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918999.690094:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb44eb0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790918999.690105:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550301696 00000100:00100000:3.0:1790918999.690108:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550301696 00000100:00100000:3.0:1790918999.690132:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1790918999.690137:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+14:5842:x1877914550301696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790918999.690145:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790918999.690155:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be81517400/0xc3296956897c427c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c4275 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918999.690172:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be81517400/0xc3296956897c427c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c4275 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918999.690180:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be81517400/0xc3296956897c427c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c4275 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918999.690188:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81517400, rc 0) 00000100:00100000:3.0:1790918999.690215:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+15:5842:x1877914550301696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 77us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918999.690221:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1790918999.690248:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550301696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790918999.690259:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88be81517600/0xc3296956897c4275 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c427c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918999.690267:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88be81517600/0xc3296956897c4275 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c427c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790918999.690300:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550301824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790918999.690322:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918999.690333:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb44eb0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790918999.690343:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550301824 00000100:00100000:3.0:1790918999.690346:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550301824 00000100:00100000:3.0:1790918999.690367:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1790918999.690372:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+15:5842:x1877914550301824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790918999.690575:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+15:5842:x1877914550301824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 201us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918999.690582:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1790918999.690609:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550301824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790918999.690632:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550301952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790918999.690663:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918999.690681:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be88cb4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790918999.690691:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550301952 00000100:00100000:3.0:1790918999.690694:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550301952 00000100:00100000:3.0:1790918999.690710:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1790918999.690714:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+15:5842:x1877914550301952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790918999.690830:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+15:5842:x1877914550301952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 114us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918999.690837:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1790918999.690874:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550301952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790918999.691062:0:8487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:8487:1877914550302080:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790918999.691094:0:8487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918999.691111:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550302080 00000100:00100000:3.0:1790918999.691115:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550302080 00000100:00100000:3.0:1790918999.691133:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1790918999.691139:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+15:8487:x1877914550302080:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790918999.691270:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+15:8487:x1877914550302080:12345-0@lo:502:llog_process_th.0 Request processed in 130us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918999.691282:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1790918999.691310:0:8487:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be88cb4300 going to sleep for 11 seconds 00000100:00100000:3.0:1790918999.691321:0:8487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:8487:1877914550302080:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790918999.691355:0:8487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:8487:1877914550302208:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790918999.691385:0:8487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918999.691402:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550302208 00000100:00100000:3.0:1790918999.691405:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550302208 00000100:00100000:1.0:1790918999.694655:0:8487:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb44ebc00 going to sleep for 11 seconds 00000100:00100000:3.0:1790918999.694797:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1790918999.694824:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+15:8487:x1877914550302208:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790918999.695148:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+15:8487:x1877914550302208:12345-0@lo:502:llog_process_th.0 Request processed in 338us (3761us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918999.697756:0:8487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:8487:1877914550302208:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1790918999.697812:0:8487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1790918999.697994:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1790918999.698014:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790918999.698037:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be81517600/0xc3296956897c4275 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c427c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918999.698048:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88be81517600/0xc3296956897c4275 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c427c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790918999.698059:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1790918999.698061:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1790918999.698064:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1790918999.698097:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be88387e00/0xc3296956897c4283 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918999.698106:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88be88387e00/0xc3296956897c4283 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918999.698116:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88be88387e00/0xc3296956897c4283 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790918999.698136:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550302336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790918999.698193:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918999.698233:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be84f6eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1790918999.698289:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550302336 00000100:00100000:0.0:1790918999.698296:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550302336 00000100:00100000:0.0:1790918999.698344:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1790918999.698354:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+16:5842:x1877914550302336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790918999.698366:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790918999.698378:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88bd81146800/0xc3296956897c428a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c4283 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918999.698402:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88bd81146800/0xc3296956897c428a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c4283 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918999.698411:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88bd81146800/0xc3296956897c428a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c4283 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918999.698419:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bd81146800, rc 0) 00000100:00100000:0.0:1790918999.698479:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:5842:x1877914550302336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918999.698485:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1790918999.698570:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550302336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790918999.698583:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88be88387e00/0xc3296956897c4283 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c428a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918999.698593:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88be88387e00/0xc3296956897c4283 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c428a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790918999.698638:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb0b1f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550302464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790918999.698662:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918999.698683:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be86b02000 going to sleep for 11 seconds 00000100:00100000:0.0:1790918999.698725:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550302464 00000100:00100000:0.0:1790918999.698729:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550302464 00000100:00100000:0.0:1790918999.698744:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1790918999.698750:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:5842:x1877914550302464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790918999.699018:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:5842:x1877914550302464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 266us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918999.699026:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1790918999.699124:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb0b1f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550302464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790918999.699152:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb0b1f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550302592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790918999.699194:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918999.699219:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be86b02000 going to sleep for 11 seconds 00000100:00100000:0.0:1790918999.699262:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550302592 00000100:00100000:0.0:1790918999.699265:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550302592 00000100:00100000:0.0:1790918999.699293:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1790918999.699300:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:5842:x1877914550302592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790918999.699448:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:5842:x1877914550302592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918999.699455:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1790918999.699605:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb0b1f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550302592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790918999.699958:0:8488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb0b1f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:8488:1877914550302720:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790918999.699992:0:8488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918999.700017:0:8488:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be86b020c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790918999.700061:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550302720 00000100:00100000:0.0:1790918999.700066:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550302720 00000100:00100000:0.0:1790918999.700094:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1790918999.700100:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:8488:x1877914550302720:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790918999.700253:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:8488:x1877914550302720:12345-0@lo:502:llog_process_th.0 Request processed in 152us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918999.700260:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1790918999.700360:0:8488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb0b1f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:8488:1877914550302720:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790918999.700387:0:8488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790918999.700395:0:8488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790918999.700397:0:8488:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790918999.700402:0:8488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1790918999.700430:0:8488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb0b1f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:8488:1877914550302848:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790918999.700462:0:8488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918999.700483:0:8488:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be86b020c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790918999.700552:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550302848 00000100:00100000:0.0:1790918999.700557:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550302848 00000100:00100000:0.0:1790918999.700623:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1790918999.700630:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:8488:x1877914550302848:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790918999.700744:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:8488:x1877914550302848:12345-0@lo:502:llog_process_th.0 Request processed in 115us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918999.700751:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1790918999.700816:0:8488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb0b1f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:8488:1877914550302848:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790918999.700836:0:8488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790918999.700839:0:8488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790918999.700841:0:8488:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790918999.700844:0:8488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000100:00100000:3.0:1790918999.702622:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000020:01000000:2.0:1790918999.702738:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1790918999.702762:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1790918999.702773:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be88387e00/0xc3296956897c4283 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c428a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918999.702785:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88be88387e00/0xc3296956897c4283 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c428a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790918999.702794:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1790918999.702806:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88be91614800 from 39 10000000:01000000:2.0:1790918999.702808:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790918999.702838:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be88387600/0xc3296956897c4291 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918999.702846:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88be88387600/0xc3296956897c4291 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918999.702857:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88be88387600/0xc3296956897c4291 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790918999.702876:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550302976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790918999.702923:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918999.706578:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be84f6e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790918999.706795:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550302976 00000100:00100000:0.0:1790918999.706805:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550302976 00000100:00100000:0.0:1790918999.710248:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1790918999.710262:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+16:5842:x1877914550302976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790918999.710281:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790918999.710301:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88bd81147e00/0xc3296956897c4298 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c4291 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918999.710329:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88bd81147e00/0xc3296956897c4298 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c4291 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918999.710342:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88bd81147e00/0xc3296956897c4298 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c4291 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918999.710350:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bd81147e00, rc 0) 00000100:00100000:0.0:1790918999.710445:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:5842:x1877914550302976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 186us (7520us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918999.710452:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1790918999.710579:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550302976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790918999.710598:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88be88387600/0xc3296956897c4291 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c4298 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918999.710608:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88be88387600/0xc3296956897c4291 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c4298 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790918999.710676:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550303104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790918999.710709:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918999.710739:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be84f6e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790918999.711018:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550303104 00000100:00100000:0.0:1790918999.711025:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550303104 00000100:00100000:0.0:1790918999.711045:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1790918999.711051:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:5842:x1877914550303104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790918999.711284:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:5842:x1877914550303104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 232us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918999.711292:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1790918999.711399:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550303104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790918999.711437:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550303232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790918999.711473:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918999.711495:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be84f6e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790918999.711548:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550303232 00000100:00100000:0.0:1790918999.711552:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550303232 00000100:00100000:0.0:1790918999.711569:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1790918999.711574:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:5842:x1877914550303232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790918999.711715:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:5842:x1877914550303232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918999.711728:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1790918999.711805:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550303232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790918999.712128:0:8489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:8489:1877914550303360:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790918999.712160:0:8489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918999.712188:0:8489:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be84f6e840 going to sleep for 11 seconds 00000100:00100000:0.0:1790918999.712235:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550303360 00000100:00100000:0.0:1790918999.712239:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550303360 00000100:00100000:0.0:1790918999.712256:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1790918999.712261:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:8489:x1877914550303360:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790918999.712433:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:8489:x1877914550303360:12345-0@lo:502:llog_process_th.0 Request processed in 161us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918999.712440:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1790918999.712519:0:8489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:8489:1877914550303360:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790918999.712586:0:8489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:8489:1877914550303488:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790918999.712615:0:8489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918999.712626:0:8489:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be84f6e840 going to sleep for 11 seconds 00000100:00100000:0.0:1790918999.712675:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550303488 00000100:00100000:0.0:1790918999.712679:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550303488 00000100:00100000:0.0:1790918999.712695:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1790918999.712700:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:8489:x1877914550303488:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790918999.712829:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:8489:x1877914550303488:12345-0@lo:502:llog_process_th.0 Request processed in 128us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918999.712835:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1790918999.712907:0:8489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:8489:1877914550303488:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1790918999.712925:0:8489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1790918999.713054:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1790918999.713068:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790918999.713076:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be88387600/0xc3296956897c4291 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c4298 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918999.713086:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88be88387600/0xc3296956897c4291 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c4298 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790918999.713096:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1790918999.713099:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1790918999.713102:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1790918999.713122:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88bd81147c00/0xc3296956897c429f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918999.713135:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88bd81147c00/0xc3296956897c429f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918999.713145:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88bd81147c00/0xc3296956897c429f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790918999.713157:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88d98e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550303616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790918999.713185:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790918999.713262:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb0b04540 going to sleep for 11 seconds 00000100:00100000:3.0:1790918999.715332:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550303616 00000100:00100000:3.0:1790918999.715344:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550303616 00000100:00100000:3.0:1790918999.715412:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1790918999.715440:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87167450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:5842:x1877914550303616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790918999.715458:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790918999.715476:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be81516400/0xc3296956897c42a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c429f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918999.715503:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be81516400/0xc3296956897c42a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c429f expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918999.715514:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be81516400/0xc3296956897c42a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c429f expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790918999.715568:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81516400, rc 0) 00000100:00100000:3.0:1790918999.715629:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87167450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:5842:x1877914550303616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 210us (2444us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918999.715636:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1790918999.715766:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88d98e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550303616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790918999.715784:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88bd81147c00/0xc3296956897c429f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c42a6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918999.715792:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88bd81147c00/0xc3296956897c429f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c42a6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790918999.715853:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88d98e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550303744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790918999.715884:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790918999.715916:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb0b04540 going to sleep for 11 seconds 00000100:00100000:3.0:1790918999.718771:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550303744 00000100:00100000:3.0:1790918999.718784:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550303744 00000100:00100000:3.0:1790918999.718826:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1790918999.718835:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:5842:x1877914550303744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790918999.719132:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:5842:x1877914550303744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 297us (3246us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918999.719140:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1790918999.719256:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88d98e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550303744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790918999.719301:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88d98e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550303872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790918999.719345:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790918999.719377:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb0b04540 going to sleep for 11 seconds 00000100:00100000:3.0:1790918999.719431:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550303872 00000100:00100000:3.0:1790918999.719436:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550303872 00000100:00100000:3.0:1790918999.719453:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1790918999.719459:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87165c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:5842:x1877914550303872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790918999.723938:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87165c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:5842:x1877914550303872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4469us (4583us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918999.723972:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1790918999.726130:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88d98e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550303872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790918999.726518:0:8490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:8490:1877914550304000:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790918999.726625:0:8490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918999.726660:0:8490:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb44ebb40 going to sleep for 11 seconds 00000100:00100000:1.0:1790918999.726716:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550304000 00000100:00100000:1.0:1790918999.726723:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550304000 00000100:00100000:1.0:1790918999.726763:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1790918999.726771:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:8490:x1877914550304000:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790918999.727016:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:8490:x1877914550304000:12345-0@lo:502:llog_process_th.0 Request processed in 244us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1790918999.727024:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1790918999.727159:0:8490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:8490:1877914550304000:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790918999.727184:0:8490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790918999.727192:0:8490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790918999.727195:0:8490:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1790918999.727201:0:8490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1790918999.727220:0:8490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:8490:1877914550304128:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790918999.727251:0:8490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790918999.727277:0:8490:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb44ebb40 going to sleep for 11 seconds 00000100:00100000:0.0:1790918999.727317:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550304128 00000100:00100000:0.0:1790918999.727321:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550304128 00000100:00100000:0.0:1790918999.727349:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1790918999.727356:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87166c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:8490:x1877914550304128:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790918999.727496:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87166c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:8490:x1877914550304128:12345-0@lo:502:llog_process_th.0 Request processed in 140us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1790918999.727502:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1790918999.727626:0:8490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:8490:1877914550304128:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790918999.727645:0:8490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790918999.727649:0:8490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790918999.727651:0:8490:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1790918999.727655:0:8490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1790918999.727817:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1790918999.727834:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1790918999.727845:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88bd81147c00/0xc3296956897c429f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c42a6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918999.727855:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88bd81147c00/0xc3296956897c429f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c42a6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790918999.727863:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1790918999.727866:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff88be88d33380 from 1 10000000:01000000:0.0:1790918999.727868:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790918999.727909:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88bd81146e00/0xc3296956897c42ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918999.727918:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88bd81146e00/0xc3296956897c42ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790918999.727927:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88bd81146e00/0xc3296956897c42ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790918999.727939:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88d98e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550304256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790918999.727977:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790918999.728003:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb0b04540 going to sleep for 11 seconds 00000100:00100000:2.0:1790918999.728049:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550304256 00000100:00100000:2.0:1790918999.728054:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550304256 00000100:00100000:2.0:1790918999.728085:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1790918999.728091:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:5842:x1877914550304256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790918999.728100:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790918999.728112:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be88387800/0xc3296956897c42b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c42ad expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918999.728132:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be88387800/0xc3296956897c42b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c42ad expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918999.728141:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be88387800/0xc3296956897c42b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c42ad expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790918999.728149:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be88387800, rc 0) 00000100:00100000:2.0:1790918999.728187:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:5842:x1877914550304256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918999.728200:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1790918999.728258:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88d98e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550304256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790918999.728269:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88bd81146e00/0xc3296956897c42ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c42b4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918999.728277:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88bd81146e00/0xc3296956897c42ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c42b4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790918999.728325:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb0b1f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550304384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790918999.728350:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790918999.728370:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be86b026c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790918999.728407:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550304384 00000100:00100000:2.0:1790918999.728412:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550304384 00000100:00100000:2.0:1790918999.728449:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1790918999.728456:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:5842:x1877914550304384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790918999.728707:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:5842:x1877914550304384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 249us (353us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790918999.728714:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1790918999.728840:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb0b1f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550304384:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1790918999.728858:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1790918999.728863:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88bd81146e00/0xc3296956897c42ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c42b4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790918999.728870:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88bd81146e00/0xc3296956897c42ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c42b4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790918999.757494:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790918999.757574:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532451584 00000100:00100000:3.0:1790918999.757581:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790918999.757585:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532451584 00000100:00100000:3.0:1790918999.757629:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790918999.757664:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 27 00000100:00100000:3.0:1790918999.757665:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790918999.757680:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2352:x1877914532451584:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1790918999.757694:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532451840 00000100:00100000:3.0:1790918999.757699:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532451840 00000100:00100000:3.0:1790918999.757732:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532451712 00000100:00100000:3.0:1790918999.757735:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532451712 00000100:00100000:3.0:1790918999.757756:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 11 00000100:00100000:2.0:1790918999.757758:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2352:x1877914532451584:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 80us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918999.757767:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2352:x1877914532451840:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:2.0:1790918999.757769:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 27 00000100:00100000:3.0:1790918999.757805:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2352:x1877914532451840:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 39us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918999.757812:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 11 00000100:00100000:3.0:1790918999.757829:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 12 00000100:00100000:3.0:1790918999.757837:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2352:x1877914532451712:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1790918999.757869:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2352:x1877914532451712:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 33us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1790918999.757878:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 12 00000100:00100000:2.0:1790918999.757888:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532451456 00000100:00100000:2.0:1790918999.757893:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532451456 00000100:00100000:2.0:1790918999.757923:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 171 00000100:00100000:2.0:1790918999.757930:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+10:2352:x1877914532451456:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:2.0:1790918999.757969:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+10:2352:x1877914532451456:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 40us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918999.757976:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 171 00000100:00080000:0.0:1790918999.758055:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790918999.758070:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790918999.758073:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790918999.807925:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88d99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550304512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790918999.808002:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790918999.808149:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550304512 00000100:00100000:2.0:1790918999.808158:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550304512 00000100:00100000:2.0:1790918999.808267:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790918999.808276:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550304512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790918999.808320:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790918999.808378:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550304512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1790918999.808385:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1790918999.809202:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88be88d99c00 x1877914550304512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919015 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790918999.809224:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88d99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550304512:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790918999.810147:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790919000.321277:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790919000.882297:0:8527:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc9f4c5d20 20000000:00000080:3.0:1790919000.882317:0:8527:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff88be86ba2c00 uarg=0000000000000000 20000000:01000000:3.0:1790919000.882353:0:8527:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1790919000.882359:0:8527:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1790919000.882364:0:8527:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1790919000.883438:0:8528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1790919000.883844:0:8527:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1790919000.888438:0:8527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1790919000.888511:0:8527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1790919000.888942:0:8527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1790919000.888962:0:8527:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790919000.888982:0:8527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88be81516800/0xc3296956897c42bb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919000.888999:0:8527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88be80030a00/0xc3296956897c4030 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c4029 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919000.889007:0:8527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88be80030600/0xc3296956897c4092 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c408b expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919000.889013:0:8527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88be81673600/0xc3296956897c415d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c4156 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919000.889022:0:8527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88be88387c00/0xc3296956897c421a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672caca expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919000.889029:0:8527:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88be81516800/0xc3296956897c42bb lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919000.889081:0:8527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88be88387c00/0xc3296956897c421a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672caca expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919000.889096:0:8527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88be88387c00/0xc3296956897c421a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672caca expref: 9 pid: 5839 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919000.889111:0:8527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8527:1877914550304640:192.168.201.27@tcp:104: 00010000:00010000:3.0:1790919000.889274:0:8527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88be81673600/0xc3296956897c415d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3296956897c4156 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919000.889284:0:8527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88be81673600/0xc3296956897c415d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3296956897c4156 expref: 18 pid: 5840 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919000.889294:0:8527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8527:1877914550304768:0@lo:104: 00000100:00100000:3.0:1790919000.889332:0:8527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790919000.889370:0:8527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88be80030600/0xc3296956897c4092 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3296956897c408b expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919000.889379:0:8527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88be80030600/0xc3296956897c4092 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3296956897c408b expref: 18 pid: 5838 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919000.889387:0:8527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8527:1877914550304896:0@lo:104: 00000100:00100000:3.0:1790919000.889422:0:8527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919000.889456:0:5827:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1790919000.889465:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550304768 00000100:00100000:3.0:1790919000.889472:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550304768 00000100:00100000:1.0:1790919000.889796:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550304896 00000100:00100000:1.0:1790919000.889801:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550304896 00000100:00100000:1.0:1790919000.889844:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790919000.889853:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be86ba3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+3:8527:x1877914550304896:12345-0@lo:104: 00010000:00010000:1.0:1790919000.889866:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.127@tcp lock: ffff88be813a3c00/0xc3296956897c408b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c4092 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919000.889925:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790919000.889931:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be86ba3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+3:8527:x1877914550304896:12345-0@lo:104: Request processed in 79us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919000.889938:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:0.0:1790919000.890000:0:7650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919000.890008:0:7650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff88be813a3c00/0xc3296956897c408b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c4092 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919000.890016:0:7650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be813a3c00 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:0.0:1790919000.890020:0:7650:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff88be813a3c00/0xc3296956897c408b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3296956897c4092 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919000.890029:0:7650:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff88be813a3c00/0xc3296956897c408b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3296956897c4092 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790919000.890036:0:7650:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff88be813a3c00/0xc3296956897c408b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3296956897c4092 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919000.890042:0:7650:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790919000.890075:0:7650:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff88be813a3c00/0xc3296956897c408b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c4092 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919000.890082:0:7650:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790919000.890102:0:7650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff88be813a3c00/0xc3296956897c408b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c4092 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919000.890109:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff88be813a3c00/0xc3296956897c408b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c4092 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919000.890138:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919000.890140:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919000.890142:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919000.890164:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88d99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3308:1877914550305024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790919000.890194:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919000.890241:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550305024 00000100:00100000:0.0:1790919000.890246:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550305024 00010000:00010000:0.0:1790919000.890262:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88be80030600/0xc3296956897c4092 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c408b expref: 19 pid: 5838 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919000.890283:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790919000.890289:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88d98e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3308:x1877914550305024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790919000.890299:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919000.890304:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88be80030600/0xc3296956897c4092 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c408b expref: 19 pid: 5838 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919000.890312:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88be80030600/0xc3296956897c4092 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3296956897c408b expref: 19 pid: 5838 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919000.890327:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919000.890354:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88d98e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3308:x1877914550305024:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919000.890360:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790919000.890393:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88d99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3308:1877914550305024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790919000.890740:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790919000.890747:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+3:8527:x1877914550304768:12345-0@lo:104: 00010000:00010000:3.0:1790919000.890762:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.127@tcp lock: ffff88bd81147200/0xc3296956897c4156 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c415d expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919000.890797:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790919000.890802:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+3:8527:x1877914550304768:12345-0@lo:104: Request processed in 56us (1470us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919000.890807:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:3.0:1790919000.890858:0:8527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88be80030a00/0xc3296956897c4030 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3296956897c4029 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919000.890868:0:8527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88be80030a00/0xc3296956897c4030 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3296956897c4029 expref: 18 pid: 5840 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919000.890877:0:8527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8527:1877914550305152:0@lo:104: 00000100:00100000:3.0:1790919000.890900:0:8527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919000.890918:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550305152 00000100:00100000:3.0:1790919000.890922:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550305152 00000100:00100000:3.0:1790919000.890939:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790919000.890945:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+3:8527:x1877914550305152:12345-0@lo:104: 00010000:00010000:3.0:1790919000.890952:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.127@tcp lock: ffff88be81672e00/0xc3296956897c4029 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c4030 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919000.890982:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790919000.890987:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+3:8527:x1877914550305152:12345-0@lo:104: Request processed in 43us (88us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919000.890993:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790919000.891010:0:8527:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb44ebb40 going to sleep for 11 seconds 00000100:00100000:3.0:1790919000.891022:0:8527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8527:1877914550304768:0@lo:104: 00010000:00010000:3.0:1790919000.891031:0:8527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be80030600/0xc3296956897c4092 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3296956897c408b expref: 18 pid: 5838 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919000.891047:0:8527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8527:1877914550304896:0@lo:104: 00000100:00100000:3.0:1790919000.891057:0:8527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8527:1877914550305152:0@lo:104: 00010000:00010000:3.0:1790919000.891083:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790919000.891088:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff88bd81147200/0xc3296956897c4156 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c415d expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919000.891095:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bd81147200 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:3.0:1790919000.891098:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff88bd81147200/0xc3296956897c4156 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3296956897c415d expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919000.891105:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff88bd81147200/0xc3296956897c4156 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3296956897c415d expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790919000.891112:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff88bd81147200/0xc3296956897c4156 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3296956897c415d expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919000.891117:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790919000.891134:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff88bd81147200/0xc3296956897c4156 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c415d expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919000.891140:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1790919000.891272:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550305280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790919000.891299:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790919000.891346:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff88bd81147200/0xc3296956897c4156 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c415d expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919000.891354:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff88bd81147200/0xc3296956897c4156 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c415d expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919000.891364:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790919000.891372:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff88be81672e00/0xc3296956897c4029 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c4030 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919000.891377:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81672e00 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:3.0:1790919000.891380:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff88be81672e00/0xc3296956897c4029 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3296956897c4030 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919000.891386:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff88be81672e00/0xc3296956897c4029 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3296956897c4030 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790919000.891393:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff88be81672e00/0xc3296956897c4029 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3296956897c4030 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919000.891398:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790919000.891425:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff88be81672e00/0xc3296956897c4029 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c4030 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919000.891431:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790919000.891489:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919000.892515:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3306:1877914550305408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790919000.894226:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919000.896380:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550305280 00000100:00100000:0.0:1790919000.896395:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550305280 00010000:00010000:0.0:1790919000.896469:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88be81673600/0xc3296956897c415d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c4156 expref: 18 pid: 5840 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919000.896650:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550305408 00000100:00100000:2.0:1790919000.896655:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550305408 00010000:00010000:2.0:1790919000.896672:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88be80030a00/0xc3296956897c4030 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c4029 expref: 19 pid: 5840 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919000.896691:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790919000.896699:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3305:x1877914550305280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790919000.896714:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919000.896719:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88be81673600/0xc3296956897c415d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c4156 expref: 19 pid: 5840 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919000.896729:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88be81673600/0xc3296956897c415d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3296956897c4156 expref: 19 pid: 5840 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919000.896747:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be81673600/0xc3296956897c415d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3296956897c4156 expref: 19 pid: 5840 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919000.896763:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919000.896851:0:5831:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1790919000.896860:0:5831:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1790919000.896964:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790919000.896970:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88db6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:3306:x1877914550305408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790919000.896978:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919000.896984:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88be80030a00/0xc3296956897c4030 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c4029 expref: 18 pid: 5840 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919000.896991:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88be80030a00/0xc3296956897c4030 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3296956897c4029 expref: 18 pid: 5840 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919000.897001:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be80030a00/0xc3296956897c4030 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3296956897c4029 expref: 18 pid: 5840 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919000.897011:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919000.897063:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88db6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:3306:x1877914550305408:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (2839us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919000.897070:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1790919000.897627:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff88be81672e00/0xc3296956897c4029 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c4030 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919000.897638:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff88be81672e00/0xc3296956897c4029 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c4030 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919000.897655:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919000.897657:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919000.897659:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919000.897699:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3306:1877914550305408:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790919000.897825:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919000.897856:0:8527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8527:1877914550304640:192.168.201.27@tcp:104: 00010000:00010000:3.0:1790919000.897889:0:8527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88be81516800/0xc3296956897c42bb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919000.898615:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532451968 00000100:00100000:3.0:1790919000.898621:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532451968 00010000:00010000:3.0:1790919000.898644:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88be88387c00/0xc3296956897c421a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672caca expref: 10 pid: 5839 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919000.898668:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 24 00000100:00100000:3.0:1790919000.898675:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:002ffd4e-702a-440d-a423-3e840d72bb2e+10:2353:x1877914532451968:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919000.898686:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919000.898691:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88be88387c00/0xc3296956897c421a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672caca expref: 10 pid: 5839 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919000.898701:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88be88387c00/0xc3296956897c421a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672caca expref: 10 pid: 5839 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919000.898715:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be88387c00/0xc3296956897c421a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672caca expref: 10 pid: 5839 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919000.898729:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88be81516800/0xc3296956897c42bb lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919000.898739:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be81516800/0xc3296956897c42bb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919000.898753:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88be81516800/0xc3296956897c42bb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919000.898760:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88be81516800/0xc3296956897c42bb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919000.898774:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88be81516800/0xc3296956897c42bb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919000.898782:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88be81516800/0xc3296956897c42bb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919000.898788:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81516800 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:3.0:1790919000.898793:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88be81516800/0xc3296956897c42bb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919000.898801:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88be81516800/0xc3296956897c42bb lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919000.898814:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88be81516800/0xc3296956897c42bb lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919000.898823:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919000.898863:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:002ffd4e-702a-440d-a423-3e840d72bb2e+9:2353:x1877914532451968:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 188us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919000.898871:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 24 00010000:00010000:3.0:1790919000.898966:0:8527:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88be81516800/0xc3296956897c42bb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919000.898975:0:8527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88be81516800/0xc3296956897c42bb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919000.898982:0:8527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be81516800/0xc3296956897c42bb lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919000.901994:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+16:3305:x1877914550305280:12345-0@lo:103:ldlm_bl.0 Request processed in 5285us (10683us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919000.902008:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790919000.908116:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550305280:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790919001.343830:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790919002.239699:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790919002.239706:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88bebf8da800 from 4 10000000:01000000:0.0:1790919002.239711:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790919002.239758:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88bd81147a00/0xc3296956897c42c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919002.239770:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88bd81147a00/0xc3296956897c42c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919002.239793:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88bd81147a00/0xc3296956897c42c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919002.239818:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88d99c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550305536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790919002.239884:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919002.239947:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be86b026c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790919002.240032:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550305536 00000100:00100000:1.0:1790919002.240041:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550305536 00000100:00100000:1.0:1790919002.240088:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1790919002.240098:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+16:5842:x1877914550305536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790919002.240112:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919002.240137:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be81672400/0xc3296956897c42c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c42c2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919002.240161:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be81672400/0xc3296956897c42c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c42c2 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919002.240172:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be81672400/0xc3296956897c42c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c42c2 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919002.240180:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81672400, rc 0) 00000100:00100000:1.0:1790919002.240238:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:5842:x1877914550305536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919002.240245:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1790919002.240389:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88d99c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550305536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790919002.240407:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88bd81147a00/0xc3296956897c42c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c42c9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919002.240416:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88bd81147a00/0xc3296956897c42c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c42c9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919002.240467:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88d99c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550305664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790919002.240491:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919002.240512:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be86b026c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790919002.240593:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550305664 00000100:00100000:2.0:1790919002.240597:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550305664 00000100:00100000:2.0:1790919002.240628:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1790919002.240634:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:5842:x1877914550305664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790919002.240872:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:5842:x1877914550305664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 237us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919002.240878:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1790919002.241283:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88d99c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550305664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790919002.241325:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550305792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790919002.241364:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919002.241405:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be9f8a4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790919002.241405:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550305792 00000100:00100000:0.0:1790919002.241409:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550305792 00000100:00100000:0.0:1790919002.241440:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1790919002.241447:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87166050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:5842:x1877914550305792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790919002.241606:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87166050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:5842:x1877914550305792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 159us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919002.241612:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1790919002.242387:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550305792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790919002.244891:0:8584:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb0b1ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:8584:1877914550305920:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790919002.244972:0:8584:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919002.245021:0:8584:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be8e285e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790919002.245253:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550305920 00000100:00100000:3.0:1790919002.245260:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550305920 00000100:00100000:3.0:1790919002.245345:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1790919002.245355:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87164c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:8584:x1877914550305920:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790919002.245618:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87164c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:8584:x1877914550305920:12345-0@lo:502:llog_process_th.0 Request processed in 264us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919002.245626:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1790919002.245792:0:8584:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb0b1ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:8584:1877914550305920:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790919002.245827:0:8584:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790919002.245836:0:8584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919002.245839:0:8584:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790919002.245846:0:8584:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88bebf8da800 00000020:00000080:1.0:1790919002.245848:0:8584:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790919002.245928:0:8584:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb0b1ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:8584:1877914550306048:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790919002.245961:0:8584:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919002.250759:0:8584:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be8e285e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790919002.251591:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550306048 00000100:00100000:0.0:1790919002.251602:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550306048 00000100:00100000:0.0:1790919002.253369:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1790919002.253406:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87165050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:8584:x1877914550306048:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790919002.253820:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87165050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:8584:x1877914550306048:12345-0@lo:502:llog_process_th.0 Request processed in 418us (7856us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919002.253829:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1790919002.256512:0:8584:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb0b1ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:8584:1877914550306048:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790919002.256580:0:8584:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790919002.256588:0:8584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919002.256590:0:8584:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1790919002.256596:0:8584:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1790919002.259594:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1790919002.259623:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790919002.259634:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88bd81147a00/0xc3296956897c42c2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c42c9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919002.259656:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88bd81147a00/0xc3296956897c42c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c42c9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919002.259666:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790919002.259669:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88be86b70000 from 4 10000000:01000000:2.0:1790919002.259671:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790919002.259705:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be88386a00/0xc3296956897c42d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919002.259714:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88be88386a00/0xc3296956897c42d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919002.259725:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88be88386a00/0xc3296956897c42d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919002.259747:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550306176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790919002.259813:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919002.259849:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be927eb600 going to sleep for 11 seconds 00000100:00100000:1.0:1790919002.261240:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550306176 00000100:00100000:1.0:1790919002.261250:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550306176 00000100:00100000:1.0:1790919002.261291:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1790919002.261298:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:5842:x1877914550306176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790919002.261312:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919002.261327:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be81673600/0xc3296956897c42d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c42d0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919002.261352:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be81673600/0xc3296956897c42d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c42d0 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919002.261362:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be81673600/0xc3296956897c42d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c42d0 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919002.261370:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81673600, rc 0) 00000100:00100000:1.0:1790919002.262565:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:5842:x1877914550306176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1260us (2745us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919002.262576:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1790919002.262830:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550306176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790919002.262851:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88be88386a00/0xc3296956897c42d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c42d7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919002.262862:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88be88386a00/0xc3296956897c42d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c42d7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919002.262928:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550306304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790919002.262959:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919002.262988:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be927eb600 going to sleep for 11 seconds 00000100:00100000:2.0:1790919002.263003:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550306304 00000100:00100000:2.0:1790919002.263007:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550306304 00000100:00100000:2.0:1790919002.263035:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1790919002.263042:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87164450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:5842:x1877914550306304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790919002.265783:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87164450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:5842:x1877914550306304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2732us (2814us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919002.265795:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1790919002.265860:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550306304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790919002.265905:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550306432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790919002.265947:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919002.265976:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be927eb600 going to sleep for 11 seconds 00000100:00100000:2.0:1790919002.265990:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550306432 00000100:00100000:2.0:1790919002.265995:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550306432 00000100:00100000:2.0:1790919002.266033:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1790919002.266042:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87167c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:5842:x1877914550306432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790919002.269862:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87167c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:5842:x1877914550306432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3808us (3902us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919002.269886:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1790919002.269985:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550306432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790919002.274584:0:8588:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb0b1ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:8588:1877914550306560:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790919002.275769:0:8588:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919002.275826:0:8588:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be8e285240 going to sleep for 11 seconds 00000100:00100000:2.0:1790919002.277321:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550306560 00000100:00100000:2.0:1790919002.277335:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550306560 00000100:00100000:2.0:1790919002.283171:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1790919002.283195:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be86bb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:8588:x1877914550306560:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790919002.283486:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be86bb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:8588:x1877914550306560:12345-0@lo:502:llog_process_th.0 Request processed in 300us (7721us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919002.283494:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1790919002.288596:0:8588:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb0b1ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:8588:1877914550306560:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790919002.289843:0:8588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790919002.289859:0:8588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919002.289861:0:8588:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790919002.289870:0:8588:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88be86b70000 00000020:00000080:1.0:1790919002.289873:0:8588:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790919002.292113:0:8588:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb0b1ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:8588:1877914550306688:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790919002.293870:0:8588:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919002.293915:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550306688 00000100:00100000:1.0:1790919002.293923:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550306688 00000100:00100000:1.0:1790919002.293968:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1790919002.293978:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be86bbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:8588:x1877914550306688:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790919002.294209:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be86bbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:8588:x1877914550306688:12345-0@lo:502:llog_process_th.0 Request processed in 232us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919002.294216:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1790919002.294267:0:8588:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be8e285240 going to sleep for 11 seconds 00000100:00100000:1.0:1790919002.294288:0:8588:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb0b1ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:8588:1877914550306688:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790919002.294324:0:8588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790919002.294331:0:8588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919002.294333:0:8588:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1790919002.294340:0:8588:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1790919002.294652:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1790919002.294672:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790919002.294682:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be88386a00/0xc3296956897c42d0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c42d7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919002.294692:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88be88386a00/0xc3296956897c42d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c42d7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919002.294708:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790919002.294710:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88be91614800 from 4 10000000:01000000:1.0:1790919002.294713:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790919002.294740:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be81672e00/0xc3296956897c42de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919002.294747:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88be81672e00/0xc3296956897c42de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919002.294755:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88be81672e00/0xc3296956897c42de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919002.294774:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb0b1ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550306816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790919002.294803:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919002.294817:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be8e285240 going to sleep for 11 seconds 00000100:00100000:1.0:1790919002.294830:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550306816 00000100:00100000:1.0:1790919002.294833:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550306816 00000100:00100000:1.0:1790919002.294854:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1790919002.294860:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be86bb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:5842:x1877914550306816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790919002.294872:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919002.294886:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be81673800/0xc3296956897c42e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c42de expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919002.294911:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be81673800/0xc3296956897c42e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c42de expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919002.294923:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be81673800/0xc3296956897c42e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c42de expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919002.294946:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81673800, rc 0) 00000100:00100000:1.0:1790919002.294981:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be86bb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:5842:x1877914550306816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919002.294986:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1790919002.295135:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb0b1ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550306816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790919002.295148:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88be81672e00/0xc3296956897c42de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c42e5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919002.295156:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88be81672e00/0xc3296956897c42de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c42e5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919002.295195:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb0b1ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550306944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790919002.295222:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919002.295236:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be8e285240 going to sleep for 11 seconds 00000100:00100000:1.0:1790919002.295250:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550306944 00000100:00100000:1.0:1790919002.295254:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550306944 00000100:00100000:1.0:1790919002.295280:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1790919002.295288:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be86bba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:5842:x1877914550306944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790919002.295521:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be86bba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:5842:x1877914550306944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 233us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919002.295554:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1790919002.295586:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb0b1ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550306944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790919002.295615:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb0b1ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550307072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790919002.295666:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919002.295688:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be8e285240 going to sleep for 11 seconds 00000100:00100000:1.0:1790919002.295700:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550307072 00000100:00100000:1.0:1790919002.295704:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550307072 00000100:00100000:1.0:1790919002.295724:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1790919002.295730:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be86bb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:5842:x1877914550307072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790919002.295858:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be86bb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:5842:x1877914550307072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919002.295864:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1790919002.295973:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb0b1ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550307072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790919002.298308:0:8591:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb0b1ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:8591:1877914550307200:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790919002.298396:0:8591:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919002.298428:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550307200 00000100:00100000:1.0:1790919002.298435:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550307200 00000100:00100000:1.0:1790919002.298469:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1790919002.298477:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be86bb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:8591:x1877914550307200:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790919002.299181:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be86bb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:8591:x1877914550307200:12345-0@lo:502:llog_process_th.0 Request processed in 701us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919002.299191:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1790919002.299245:0:8591:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bebbe2a840 going to sleep for 11 seconds 00000100:00100000:1.0:1790919002.299265:0:8591:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb0b1ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:8591:1877914550307200:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790919002.299301:0:8591:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790919002.299311:0:8591:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919002.299313:0:8591:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790919002.299321:0:8591:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88be91614800 00000020:00000080:1.0:1790919002.299323:0:8591:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790919002.302082:0:8591:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb0b1ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:8591:1877914550307328:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790919002.303210:0:8591:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919002.303261:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550307328 00000100:00100000:1.0:1790919002.303268:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550307328 00000100:00100000:1.0:1790919002.303319:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1790919002.303328:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be86bb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:8591:x1877914550307328:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790919002.303571:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be86bb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:8591:x1877914550307328:12345-0@lo:502:llog_process_th.0 Request processed in 244us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919002.303579:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1790919002.303631:0:8591:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bebbe2a840 going to sleep for 11 seconds 00000100:00100000:1.0:1790919002.303652:0:8591:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb0b1ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:8591:1877914550307328:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790919002.303684:0:8591:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790919002.303691:0:8591:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919002.303693:0:8591:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1790919002.303698:0:8591:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1790919002.303747:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1790919002.303762:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790919002.303770:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be81672e00/0xc3296956897c42de lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c42e5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919002.303781:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88be81672e00/0xc3296956897c42de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c42e5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919002.368625:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919002.369836:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88d99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877914550307456:0@lo:400:kworker.0 00000100:00100000:0.0:1790919002.369899:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919002.369940:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf6e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550307968:0@lo:400:kworker.0 00000100:00100000:0.0:1790919002.369963:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919002.369990:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790919002.369996:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf6e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1877914550307584:0@lo:400:kworker.0 00000100:00100000:0.0:1790919002.370311:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919002.370949:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf6e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1877914550307840:0@lo:400:kworker.0 00000100:00100000:3.0:1790919002.370986:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919002.371026:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790919002.371032:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf6e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550307712:0@lo:400:kworker.0 00000100:00100000:3.0:1790919002.371055:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919002.371080:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550307968 00000100:00100000:3.0:1790919002.371087:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550307968 00000100:00100000:1.0:1790919002.371215:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550307456 00000100:00100000:1.0:1790919002.371219:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550307456 00000100:00100000:1.0:1790919002.371251:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550307584 00000100:00100000:1.0:1790919002.371255:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550307584 00000100:00100000:1.0:1790919002.371268:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550307840 00000100:00100000:1.0:1790919002.371270:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550307840 00000100:00100000:1.0:1790919002.371284:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790919002.371300:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877914550307456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919002.371348:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877914550307456:12345-0@lo:400:kworker.0 Request processed in 49us (1450us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919002.371356:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790919002.371518:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550307712 00000100:00100000:3.0:1790919002.371522:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550307712 00000100:00100000:3.0:1790919002.371599:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790919002.371607:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550307968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919002.371647:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550307968:12345-0@lo:400:kworker.0 Request processed in 33us (1674us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919002.371654:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790919002.371672:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790919002.371678:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550307712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919002.371709:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550307712:12345-0@lo:400:kworker.0 Request processed in 31us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919002.371715:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1790919002.371737:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790919002.371742:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790919002.371744:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1790919002.371777:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebf6e5f80 x1877914550307712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919002.371791:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf6e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550307712:0@lo:400:kworker.0 00000100:00100000:1.0:1790919002.373234:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790919002.373253:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877914550307584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919002.373317:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877914550307584:12345-0@lo:400:kworker.0 Request processed in 71us (3005us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919002.373323:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790919002.373349:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790919002.373355:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877914550307840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919002.373413:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877914550307840:12345-0@lo:400:kworker.0 Request processed in 59us (2426us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919002.373420:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790919002.373594:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf6e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1877914550307840:0@lo:400:kworker.0 00000100:00100000:0.0:1790919002.375787:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf6e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1877914550307584:0@lo:400:kworker.0 00000100:00100000:0.0:1790919002.375807:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88d99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877914550307456:0@lo:400:kworker.0 00010000:00080000:0.0:1790919002.375820:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebf6e5500 x1877914550307968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919002.375832:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf6e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550307968:0@lo:400:kworker.0 00000100:00100000:2.0:1790919002.880237:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790919002.880263:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb0b1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550308096:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790919002.880334:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919002.884884:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550308096 00000100:00100000:3.0:1790919002.884899:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550308096 00000100:00100000:3.0:1790919002.884975:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790919002.884986:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88db5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550308096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790919002.885036:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919002.885139:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88db5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550308096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 155us (4804us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919002.885146:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1790919002.885570:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88beb0b1ed80 x1877914550308096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919018 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919002.885591:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb0b1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550308096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790919002.899152:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919002.899179:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532452096 00000100:00100000:1.0:1790919002.899188:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532452096 00000100:00100000:1.0:1790919002.899233:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 187 00000100:00100000:1.0:1790919002.899241:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be86bb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+9:5591:x1877914532452096:12345-192.168.201.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790919002.899256:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919002.899271:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be81672c00/0xc3296956897c42ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8b413717672cb09 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919002.899298:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be81672c00/0xc3296956897c42ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb09 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919002.899309:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be81672c00/0xc3296956897c42ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb09 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919002.899327:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81672c00, rc 0) 00000100:00100000:1.0:1790919002.899385:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be86bb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+10:5591:x1877914532452096:12345-192.168.201.27@tcp:101:ll_cfg_requeue.0 Request processed in 145us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919002.899391:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 187 00000100:00100000:3.0:1790919002.902615:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919002.902756:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532452224 00000100:00100000:1.0:1790919002.902766:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532452224 00000100:00100000:1.0:1790919002.902823:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 188 00000100:00100000:1.0:1790919002.902832:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be86bbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+10:5591:x1877914532452224:12345-192.168.201.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790919002.903139:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be86bbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+10:5591:x1877914532452224:12345-192.168.201.27@tcp:501:ll_cfg_requeue.0 Request processed in 307us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919002.903147:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 188 00000100:00100000:3.0:1790919002.906681:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919002.906754:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532452352 00000100:00100000:1.0:1790919002.906763:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532452352 00000100:00100000:1.0:1790919002.906815:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 189 00000100:00100000:1.0:1790919002.906824:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be86bbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+10:5591:x1877914532452352:12345-192.168.201.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790919002.908152:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be86bbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+10:5591:x1877914532452352:12345-192.168.201.27@tcp:503:ll_cfg_requeue.0 Request processed in 1323us (1474us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919002.908164:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 189 00000100:00100000:0.0:1790919002.931668:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919002.936888:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532452480 00000100:00100000:3.0:1790919002.936902:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532452480 00000100:00100000:3.0:1790919002.936953:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 190 00000100:00100000:3.0:1790919002.936962:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be86bba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+10:6127:x1877914532452480:12345-192.168.201.27@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790919002.938396:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be86bba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+10:6127:x1877914532452480:12345-192.168.201.27@tcp:502:llog_process_th.0 Request processed in 1430us (6734us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919002.938407:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 190 00000100:00100000:3.0:1790919002.950028:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919002.950204:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532452608 00000100:00100000:1.0:1790919002.950213:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532452608 00000100:00100000:1.0:1790919002.950270:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 191 00000100:00100000:1.0:1790919002.950280:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be86bb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+10:6127:x1877914532452608:12345-192.168.201.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790919002.950562:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be86bb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+10:6127:x1877914532452608:12345-192.168.201.27@tcp:502:llog_process_th.0 Request processed in 282us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919002.950580:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 191 00010000:00010000:3.0:1790919003.392140:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919004.421750:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919004.908722:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919004.908758:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919004.908792:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919004.908832:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919004.908862:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532452864 00000100:00100000:3.0:1790919004.908872:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532452864 00000100:00100000:3.0:1790919004.908930:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 31 00000100:00100000:3.0:1790919004.908940:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2352:x1877914532452864:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1790919004.909013:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2352:x1877914532452864:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 75us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919004.909021:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 31 00000100:00100000:3.0:1790919004.909043:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532452992 00000100:00100000:3.0:1790919004.909046:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532452992 00000100:00100000:3.0:1790919004.909070:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532453120 00000100:00100000:3.0:1790919004.909072:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532453120 00000100:00100000:3.0:1790919004.910823:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 15 00000100:00100000:3.0:1790919004.910833:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2352:x1877914532452992:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1790919004.910885:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2352:x1877914532452992:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 54us (2126us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919004.910892:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 15 00000100:00100000:3.0:1790919004.910907:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 16 00000100:00100000:3.0:1790919004.910922:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2352:x1877914532453120:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1790919004.910947:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2352:x1877914532453120:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 26us (2116us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919004.910953:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 16 00000100:00080000:3.0:1790919004.910974:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790919004.910990:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790919004.910993:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790919004.912263:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532452736 00000100:00100000:1.0:1790919004.912275:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532452736 00000100:00100000:1.0:1790919004.912313:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 192 00000100:00100000:1.0:1790919004.912321:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88d03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+10:2352:x1877914532452736:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:1.0:1790919004.912380:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88d03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+10:2352:x1877914532452736:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 59us (3668us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919004.912386:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 192 00000100:00100000:3.0:1790919004.928991:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790919004.929025:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb0b1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550308224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790919004.929096:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919004.929278:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550308224 00000100:00100000:1.0:1790919004.929287:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550308224 00000100:00100000:1.0:1790919004.929363:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790919004.929374:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550308224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790919004.929409:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919004.929457:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550308224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919004.929464:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1790919004.929509:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88beb0b1f480 x1877914550308224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919020 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919004.929553:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb0b1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550308224:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790919004.929632:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790919005.445647:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919006.463715:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790919007.314186:0:8827:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg127-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:3.0:1790919007.488332:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf6e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550308736:0@lo:400:kworker.0 00000100:00100000:3.0:1790919007.488422:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919007.488493:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1790919007.488500:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550308352:0@lo:400:kworker.0 00000100:00100000:3.0:1790919007.488542:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919007.488563:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf6e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1877914550308864:0@lo:400:kworker.0 00000100:00100000:3.0:1790919007.488589:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919007.488616:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf6e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877914550308480:0@lo:400:kworker.0 00000100:00100000:3.0:1790919007.488635:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919007.488646:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf6e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550308992:0@lo:400:kworker.0 00000100:00100000:3.0:1790919007.488658:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919007.488668:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790919007.488671:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf6e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1877914550308608:0@lo:400:kworker.0 00000100:00100000:3.0:1790919007.488693:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919007.488714:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550308736 00000100:00100000:3.0:1790919007.488721:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550308736 00000100:00100000:3.0:1790919007.488761:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550308992 00000100:00100000:3.0:1790919007.488763:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550308992 00000100:00100000:3.0:1790919007.488775:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790919007.488781:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550308736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919007.488832:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550308736:12345-0@lo:400:kworker.0 Request processed in 51us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919007.488840:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790919007.488854:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790919007.488859:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550308992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919007.488903:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550308992:12345-0@lo:400:kworker.0 Request processed in 44us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919007.488908:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790919007.488921:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550308352 00000100:00100000:3.0:1790919007.488923:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550308352 00000100:00100000:3.0:1790919007.488939:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1790919007.488943:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88d03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3305:x1877914550308352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919007.488962:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88d03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3305:x1877914550308352:12345-0@lo:400:kworker.0 Request processed in 19us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919007.488966:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1790919007.488983:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550308864 00000100:00100000:3.0:1790919007.488985:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550308864 00000100:00100000:3.0:1790919007.489000:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550308480 00000100:00100000:3.0:1790919007.489001:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550308480 00000100:00100000:3.0:1790919007.489007:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550308608 00000100:00100000:3.0:1790919007.489008:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550308608 00000100:00100000:3.0:1790919007.489025:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790919007.489028:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877914550308864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919007.489055:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877914550308864:12345-0@lo:400:kworker.0 Request processed in 26us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919007.489061:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790919007.489072:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790919007.489077:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877914550308480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919007.489102:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877914550308480:12345-0@lo:400:kworker.0 Request processed in 25us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919007.489107:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790919007.489114:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790919007.489118:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877914550308608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919007.489134:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877914550308608:12345-0@lo:400:kworker.0 Request processed in 17us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919007.489138:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1790919007.489152:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790919007.489155:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790919007.489156:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790919007.489182:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf6e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1877914550308608:0@lo:400:kworker.0 00000100:00100000:3.0:1790919007.489189:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf6e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877914550308480:0@lo:400:kworker.0 00010000:00080000:3.0:1790919007.489196:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebf6e0000 x1877914550308992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919007.489204:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf6e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550308992:0@lo:400:kworker.0 00000100:00100000:3.0:1790919007.489230:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550308352:0@lo:400:kworker.0 00000100:00100000:3.0:1790919007.489250:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf6e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1877914550308864:0@lo:400:kworker.0 00010000:00080000:3.0:1790919007.489259:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebf6e2680 x1877914550308736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919007.489267:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf6e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550308736:0@lo:400:kworker.0 00010000:00010000:3.0:1790919007.490644:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919007.999749:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790919008.000065:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb0b1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550309120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790919008.000139:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919008.000653:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550309120 00000100:00100000:1.0:1790919008.000674:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550309120 00000100:00100000:1.0:1790919008.000733:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790919008.000743:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550309120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790919008.000796:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919008.000856:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550309120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919008.000863:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1790919008.000993:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88beb0b1f480 x1877914550309120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919023 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919008.001023:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb0b1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550309120:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790919008.513555:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919009.535884:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919010.000589:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919010.000758:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919010.000790:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919010.000827:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919010.000857:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532453504 00000100:00100000:1.0:1790919010.000867:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532453504 00000100:00100000:1.0:1790919010.000923:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532453632 00000100:00100000:1.0:1790919010.000926:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532453632 00000100:00100000:1.0:1790919010.000946:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 19 00000100:00100000:1.0:1790919010.000956:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2352:x1877914532453504:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:1.0:1790919010.001037:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2352:x1877914532453504:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 82us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919010.001044:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 19 00000100:00100000:1.0:1790919010.001063:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 20 00000100:00100000:1.0:1790919010.001069:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2352:x1877914532453632:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:1.0:1790919010.001093:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2352:x1877914532453632:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 25us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919010.001100:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 20 00000100:00080000:1.0:1790919010.001117:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790919010.001121:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790919010.001342:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532453376 00000100:00100000:0.0:1790919010.001369:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532453376 00000100:00100000:0.0:1790919010.001415:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 35 00000100:00100000:0.0:1790919010.001433:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2352:x1877914532453376:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:0.0:1790919010.001464:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2352:x1877914532453376:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 42us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919010.001470:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 35 00000100:00080000:1.0:1790919010.002358:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790919010.002560:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532453248 00000100:00100000:2.0:1790919010.002566:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532453248 00000100:00100000:2.0:1790919010.002609:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 194 00000100:00100000:2.0:1790919010.002617:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88d02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+10:2352:x1877914532453248:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:2.0:1790919010.002660:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88d02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+10:2352:x1877914532453248:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 44us (2082us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919010.002666:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 194 00000100:00100000:3.0:1790919010.048683:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb0b1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550309248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790919010.048757:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919010.048887:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550309248 00000100:00100000:2.0:1790919010.048907:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550309248 00000100:00100000:2.0:1790919010.048968:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790919010.048977:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550309248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790919010.049012:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1790919010.049095:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790919010.054645:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550309248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5657us (5876us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919010.054661:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1790919010.055639:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88beb0b1f480 x1877914550309248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919026 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919010.055665:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb0b1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550309248:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790919010.560369:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919011.584733:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919012.608542:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf6e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550309760:0@lo:400:kworker.0 00000100:00100000:3.0:1790919012.608619:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919012.608696:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1790919012.608702:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf6e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550309376:0@lo:400:kworker.0 00000100:00100000:3.0:1790919012.608730:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919012.608751:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf6e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1877914550309888:0@lo:400:kworker.0 00000100:00100000:3.0:1790919012.608773:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919012.608796:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf6e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877914550309504:0@lo:400:kworker.0 00000100:00100000:3.0:1790919012.608818:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919012.608854:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf6e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550310016:0@lo:400:kworker.0 00000100:00100000:3.0:1790919012.608874:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919012.608890:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790919012.608895:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf6e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1877914550309632:0@lo:400:kworker.0 00000100:00100000:3.0:1790919012.608913:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919012.608942:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550309760 00000100:00100000:3.0:1790919012.608950:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550309760 00000100:00100000:3.0:1790919012.608996:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550310016 00000100:00100000:3.0:1790919012.608999:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550310016 00000100:00100000:3.0:1790919012.609017:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790919012.609025:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550309760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919012.609090:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550309760:12345-0@lo:400:kworker.0 Request processed in 66us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919012.609097:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790919012.609113:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790919012.609118:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550310016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919012.609149:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550310016:12345-0@lo:400:kworker.0 Request processed in 31us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919012.609154:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790919012.609170:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550309376 00000100:00100000:3.0:1790919012.609174:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550309376 00000100:00100000:3.0:1790919012.609209:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1790919012.609215:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88d01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3305:x1877914550309376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919012.609243:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88d01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3305:x1877914550309376:12345-0@lo:400:kworker.0 Request processed in 28us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919012.609248:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1790919012.609273:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550309888 00000100:00100000:3.0:1790919012.609283:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550309888 00000100:00100000:3.0:1790919012.609307:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550309504 00000100:00100000:3.0:1790919012.609309:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550309504 00000100:00100000:3.0:1790919012.609320:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550309632 00000100:00100000:3.0:1790919012.609322:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550309632 00000100:00100000:3.0:1790919012.609335:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790919012.609340:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877914550309888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919012.609369:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877914550309888:12345-0@lo:400:kworker.0 Request processed in 29us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919012.609374:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790919012.609384:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790919012.609389:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877914550309504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919012.609408:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877914550309504:12345-0@lo:400:kworker.0 Request processed in 19us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919012.609413:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790919012.609421:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790919012.609425:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877914550309632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919012.609444:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877914550309632:12345-0@lo:400:kworker.0 Request processed in 19us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919012.609449:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1790919012.609471:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790919012.609476:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790919012.609477:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790919012.609512:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf6e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1877914550309632:0@lo:400:kworker.0 00000100:00100000:3.0:1790919012.609522:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf6e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877914550309504:0@lo:400:kworker.0 00010000:00080000:3.0:1790919012.609556:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebf6e1c00 x1877914550310016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919012.609578:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf6e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550310016:0@lo:400:kworker.0 00000100:00100000:3.0:1790919012.609608:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf6e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550309376:0@lo:400:kworker.0 00000100:00100000:3.0:1790919012.609617:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf6e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1877914550309888:0@lo:400:kworker.0 00010000:00080000:3.0:1790919012.609625:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebf6e3800 x1877914550309760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919012.609632:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf6e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550309760:0@lo:400:kworker.0 00010000:00010000:0.0:1790919012.611769:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919013.125295:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb0b1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550310144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790919013.125364:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919013.125543:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550310144 00000100:00100000:1.0:1790919013.125557:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550310144 00000100:00100000:1.0:1790919013.125604:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790919013.125613:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550310144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790919013.125648:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919013.134815:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550310144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 9193us (9441us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919013.134831:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1790919013.136217:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88beb0b1ed80 x1877914550310144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919029 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919013.136244:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb0b1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550310144:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790919013.634479:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790919013.886377:0:9071:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg127-server.virtnet: executing yml_node 00010000:00010000:1.0:1790919014.655695:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919015.134618:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919015.134662:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919015.134696:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532453888 00000100:00100000:1.0:1790919015.134707:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532453888 00000100:00100000:1.0:1790919015.134766:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 39 00000100:00100000:1.0:1790919015.134777:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2351:x1877914532453888:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:1.0:1790919015.134851:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2351:x1877914532453888:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 76us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919015.134858:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 39 00000100:00080000:1.0:1790919015.134881:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790919015.135211:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532453760 00000100:00100000:2.0:1790919015.135217:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532453760 00000100:00100000:2.0:1790919015.135245:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 196 00000100:00100000:2.0:1790919015.135252:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+10:2351:x1877914532453760:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:2.0:1790919015.135293:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+10:2351:x1877914532453760:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 41us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919015.135299:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 196 00000100:00100000:1.0:1790919015.161908:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919015.161956:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919015.162071:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532454016 00000100:00100000:0.0:1790919015.162081:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532454016 00000100:00100000:0.0:1790919015.162147:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532454144 00000100:00100000:0.0:1790919015.162150:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532454144 00000100:00100000:0.0:1790919015.162179:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 10 00000100:00100000:0.0:1790919015.162188:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2349:x1877914532454016:12345-192.168.201.27@tcp:9:kworker.0 00000020:00000080:0.0:1790919015.162224:0:6699:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3296956897c4228 00000100:00080000:0.0:1790919015.162234:0:6699:0:(import.c:65:import_set_state_nolock()) ffff88bd82851800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790919015.162272:0:6699:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:1.0:1790919015.162556:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790919015.162561:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790919015.162825:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+2:2349:x1877914532454016:12345-192.168.201.27@tcp:9:kworker.0 Request processed in 635us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919015.162846:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 10 00000100:00100000:0.0:1790919015.162863:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 11 00000100:00100000:0.0:1790919015.162869:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2349:x1877914532454144:12345-192.168.201.27@tcp:9:kworker.0 00000020:00000080:0.0:1790919015.162883:0:6699:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3296956897c422f 00000100:00080000:0.0:1790919015.162889:0:6699:0:(import.c:65:import_set_state_nolock()) ffff88bd82856000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790919015.162909:0:6699:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1790919015.163086:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+2:2349:x1877914532454144:12345-192.168.201.27@tcp:9:kworker.0 Request processed in 216us (1139us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919015.163093:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 11 00010000:00010000:0.0:1790919015.163113:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919015.163209:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919015.175021:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf6e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550310272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790919015.175109:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919015.175258:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550310272 00000100:00100000:0.0:1790919015.175266:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550310272 00000100:00100000:0.0:1790919015.175340:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790919015.175350:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550310272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790919015.175387:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790919015.175443:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550310272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919015.175450:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1790919015.175500:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790919015.175651:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebf6e4000 x1877914550310272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919031 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919015.175670:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf6e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550310272:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790919015.680264:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919016.703775:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790919017.458032:0:9264:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.59.2 00000100:00100000:3.0:1790919017.727872:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877914550310528:0@lo:400:kworker.0 00000100:00100000:2.0:1790919017.727912:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3306:1877914550310400:0@lo:400:kworker.0 00000100:00100000:3.0:1790919017.727944:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919017.727959:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919017.728021:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be85f3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550311040:0@lo:400:kworker.0 00010000:00010000:1.0:1790919017.728040:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919017.728046:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919017.728073:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790919017.728080:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1877914550310656:0@lo:400:kworker.0 00000100:00100000:1.0:1790919017.728080:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550311040 00000100:00100000:1.0:1790919017.728091:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550311040 00000100:00100000:3.0:1790919017.728105:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919017.728152:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550310528 00000100:00100000:3.0:1790919017.728156:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550310528 00000100:00100000:1.0:1790919017.728169:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790919017.728183:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550311040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919017.728185:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550310656 00000100:00100000:3.0:1790919017.728189:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550310656 00000100:00100000:3.0:1790919017.728208:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790919017.728216:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877914550310528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919017.728273:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550311040:12345-0@lo:400:kworker.0 Request processed in 93us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919017.728281:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1790919017.728305:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790919017.728310:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790919017.728323:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790919017.728331:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877914550310656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919017.728365:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877914550310656:12345-0@lo:400:kworker.0 Request processed in 36us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919017.728371:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790919017.728411:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1877914550310656:0@lo:400:kworker.0 00010000:00080000:1.0:1790919017.728425:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88be85f3a300 x1877914550311040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919017.728434:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be85f3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550311040:0@lo:400:kworker.0 00000100:00100000:2.0:1790919017.728925:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1877914550310912:0@lo:400:kworker.0 00000100:00100000:2.0:1790919017.728956:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919017.729032:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790919017.729039:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550310784:0@lo:400:kworker.0 00000100:00100000:2.0:1790919017.729063:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919017.729099:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550310400 00000100:00100000:2.0:1790919017.729105:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550310400 00000100:00100000:2.0:1790919017.729146:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1790919017.729153:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3306:x1877914550310400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919017.729204:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3306:x1877914550310400:12345-0@lo:400:kworker.0 Request processed in 51us (1246us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919017.729210:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1790919017.729239:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550310784 00000100:00100000:2.0:1790919017.729258:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550310784 00000100:00100000:2.0:1790919017.729290:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790919017.729297:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be85f38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550310784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919017.729326:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be85f38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550310784:12345-0@lo:400:kworker.0 Request processed in 30us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919017.729332:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1790919017.729348:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790919017.729370:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88be88db6300 x1877914550310784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919017.729380:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550310784:0@lo:400:kworker.0 00000100:00100000:2.0:1790919017.729388:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3306:1877914550310400:0@lo:400:kworker.0 00000100:00100000:1.0:1790919017.729926:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550310912 00000100:00100000:1.0:1790919017.729933:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550310912 00000100:00100000:1.0:1790919017.729988:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790919017.729997:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be85f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877914550310912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919017.730042:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be85f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877914550310912:12345-0@lo:400:kworker.0 Request processed in 46us (1084us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919017.730048:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1790919017.730182:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790919017.730208:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1877914550310912:0@lo:400:kworker.0 00000100:00100000:3.0:1790919017.731512:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877914550310528:12345-0@lo:400:kworker.0 Request processed in 3291us (3563us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919017.731523:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790919017.731662:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877914550310528:0@lo:400:kworker.0 00000100:00100000:2.0:1790919018.239834:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb0b1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550311168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790919018.239923:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919018.240688:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550311168 00000100:00100000:0.0:1790919018.240698:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550311168 00000100:00100000:0.0:1790919018.240794:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790919018.240805:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be85f39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550311168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790919018.240842:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790919018.241082:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be85f39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550311168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 278us (1171us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919018.241127:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1790919018.241251:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88beb0b1fb80 x1877914550311168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919034 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919018.241274:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb0b1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550311168:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790919018.752970:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790919019.329430:0:7662:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c4a4e085-55d7-40e9-993c-11b4dfc2d5f5 00000020:00000080:1.0:1790919019.329440:0:7662:0:(genops.c:885:class_export_put()) final put ffff88bd82852000/c4a4e085-55d7-40e9-993c-11b4dfc2d5f5 00000020:00000080:1.0:1790919019.329474:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88bd82852000/c4a4e085-55d7-40e9-993c-11b4dfc2d5f5 for lustre-OST0001 00000020:00000080:1.0:1790919019.329560:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88bd82856000 for lustre-OST0001 00010000:00010000:0.0:1790919019.787313:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790919019.882954:0:6722:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c4a4e085-55d7-40e9-993c-11b4dfc2d5f5 00000020:00000080:3.0:1790919019.882965:0:6722:0:(genops.c:885:class_export_put()) final put ffff88bd82856800/c4a4e085-55d7-40e9-993c-11b4dfc2d5f5 00000020:00000080:0.0:1790919019.886670:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88bd82856800/c4a4e085-55d7-40e9-993c-11b4dfc2d5f5 for lustre-OST0000 00000020:00000080:0.0:1790919019.891411:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88bd82851800 for lustre-OST0000 00000001:02000400:2.0:1790919019.943234:0:9364:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.59.2 00000100:00100000:1.0:1790919020.237407:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919020.237455:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919020.237577:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532454400 00000100:00100000:2.0:1790919020.237594:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532454400 00000100:00100000:2.0:1790919020.237664:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 43 00000100:00100000:2.0:1790919020.237674:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2350:x1877914532454400:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:2.0:1790919020.237753:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2350:x1877914532454400:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 80us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919020.237762:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 43 00000100:00080000:1.0:1790919020.238028:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790919020.238255:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532454272 00000100:00100000:3.0:1790919020.238261:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532454272 00000100:00100000:2.0:1790919020.238449:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 198 00000100:00100000:2.0:1790919020.238458:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+10:2350:x1877914532454272:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:2.0:1790919020.238553:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+10:2350:x1877914532454272:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 95us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919020.238560:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 198 00000100:00100000:3.0:1790919020.287814:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790919020.287837:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf6e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550311296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790919020.287975:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919020.288324:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550311296 00000100:00100000:1.0:1790919020.288332:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550311296 00000100:00080000:2.0:1790919020.288397:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790919020.288748:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790919020.288760:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550311296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790919020.288796:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919020.288861:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550311296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919020.288868:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1790919020.288939:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebf6e5180 x1877914550311296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919036 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919020.288958:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf6e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550311296:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790919020.799996:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919021.826585:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790919022.177421:0:9461:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.59.2 00010000:00010000:0.0:1790919022.847775:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919022.848303:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf6e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3306:1877914550311424:0@lo:400:kworker.0 00000100:00100000:3.0:1790919022.848375:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919022.848437:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf6e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1877914550311936:0@lo:400:kworker.0 00000100:00100000:3.0:1790919022.848465:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919022.848489:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790919022.848495:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf6e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550311808:0@lo:400:kworker.0 00000100:00100000:3.0:1790919022.848568:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919022.848595:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf6e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877914550311552:0@lo:400:kworker.0 00000100:00100000:3.0:1790919022.848619:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919022.848635:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf6e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550312064:0@lo:400:kworker.0 00000100:00100000:3.0:1790919022.848670:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919022.848690:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790919022.848696:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf6e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1877914550311680:0@lo:400:kworker.0 00000100:00100000:3.0:1790919022.848719:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919022.848753:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550311936 00000100:00100000:3.0:1790919022.848761:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550311936 00000100:00100000:3.0:1790919022.848808:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550311552 00000100:00100000:3.0:1790919022.848811:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550311552 00000100:00100000:3.0:1790919022.848824:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550311680 00000100:00100000:3.0:1790919022.848826:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550311680 00000100:00100000:3.0:1790919022.848842:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790919022.848851:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877914550311936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919022.848907:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877914550311936:12345-0@lo:400:kworker.0 Request processed in 56us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919022.848914:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790919022.848930:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790919022.848936:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877914550311552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919022.848968:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877914550311552:12345-0@lo:400:kworker.0 Request processed in 32us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919022.848974:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790919022.848985:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790919022.848991:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877914550311680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919022.849042:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877914550311680:12345-0@lo:400:kworker.0 Request processed in 51us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919022.849048:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790919022.849083:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf6e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1877914550311680:0@lo:400:kworker.0 00000100:00100000:3.0:1790919022.849092:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf6e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877914550311552:0@lo:400:kworker.0 00000100:00100000:3.0:1790919022.849118:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf6e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1877914550311936:0@lo:400:kworker.0 00000100:00100000:2.0:1790919022.849295:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550311808 00000100:00100000:2.0:1790919022.849300:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550311808 00000100:00100000:2.0:1790919022.849352:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550312064 00000100:00100000:2.0:1790919022.849356:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550312064 00000100:00100000:2.0:1790919022.849372:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790919022.849378:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550311808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919022.849419:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550311808:12345-0@lo:400:kworker.0 Request processed in 41us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919022.849424:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790919022.849437:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790919022.849443:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550312064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919022.849471:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550312064:12345-0@lo:400:kworker.0 Request processed in 29us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919022.849483:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1790919022.849503:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790919022.849506:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790919022.849509:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790919022.849544:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebf6e4380 x1877914550311808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919022.849555:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf6e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550311808:0@lo:400:kworker.0 00000100:00100000:0.0:1790919022.849727:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550311424 00000100:00100000:0.0:1790919022.849732:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550311424 00000100:00100000:0.0:1790919022.849767:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1790919022.849774:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3306:x1877914550311424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919022.849809:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3306:x1877914550311424:12345-0@lo:400:kworker.0 Request processed in 35us (1434us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919022.849828:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00010000:00080000:3.0:1790919022.850213:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebf6e5c00 x1877914550312064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919022.850224:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf6e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550312064:0@lo:400:kworker.0 00000100:00100000:2.0:1790919022.850581:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf6e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3306:1877914550311424:0@lo:400:kworker.0 00000100:00100000:0.0:1790919023.362823:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790919023.362847:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf6e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550312192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790919023.362919:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919023.362993:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550312192 00000100:00100000:0.0:1790919023.363001:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550312192 00000100:00100000:0.0:1790919023.363071:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790919023.363081:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550312192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790919023.363121:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790919023.363169:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550312192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919023.363176:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1790919023.363225:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebf6e4e00 x1877914550312192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919039 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919023.363245:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf6e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550312192:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790919023.884567:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790919023.983213:0:9510:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Oct 2 01:30:23 EDT 2026 00010000:00010000:2.0:1790919024.896008:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919025.357805:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919025.357872:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532454656 00000100:00100000:1.0:1790919025.357878:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919025.357886:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532454656 00000100:00100000:2.0:1790919025.357989:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532454528 00000100:00100000:2.0:1790919025.357994:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532454528 00000100:00100000:2.0:1790919025.358059:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 200 00000100:00100000:2.0:1790919025.358071:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+10:2352:x1877914532454528:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:2.0:1790919025.358178:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+10:2352:x1877914532454528:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 109us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919025.358188:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 200 00000100:00100000:3.0:1790919025.360078:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 47 00000100:00080000:1.0:1790919025.360080:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790919025.360099:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2353:x1877914532454656:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1790919025.360191:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2353:x1877914532454656:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 97us (2403us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919025.360198:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 47 00000100:00100000:1.0:1790919025.408440:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790919025.408475:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb0b1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550312320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790919025.408591:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919025.408671:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550312320 00000100:00100000:1.0:1790919025.408681:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550312320 00000100:00100000:1.0:1790919025.408750:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790919025.408762:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550312320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790919025.408810:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919025.408861:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550312320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919025.408869:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1790919025.408907:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790919025.408943:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88beb0b1ed80 x1877914550312320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919041 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919025.408965:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb0b1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550312320:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790919025.921585:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919026.943745:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919027.967748:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf6e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877914550312576:0@lo:400:kworker.0 00000100:00100000:0.0:1790919027.967850:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919027.967912:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf6e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550313088:0@lo:400:kworker.0 00000100:00100000:0.0:1790919027.967961:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919027.968000:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790919027.968006:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf6e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1877914550312704:0@lo:400:kworker.0 00000100:00100000:0.0:1790919027.968032:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919027.968079:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550312576 00000100:00100000:0.0:1790919027.968089:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550312576 00000100:00100000:0.0:1790919027.968151:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550312704 00000100:00100000:0.0:1790919027.968155:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550312704 00000100:00100000:0.0:1790919027.968189:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790919027.968199:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877914550312576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919027.968268:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877914550312576:12345-0@lo:400:kworker.0 Request processed in 70us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919027.968276:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790919027.968294:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790919027.968300:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877914550312704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919027.968329:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877914550312704:12345-0@lo:400:kworker.0 Request processed in 28us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919027.968335:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1790919027.968355:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790919027.968391:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf6e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1877914550312704:0@lo:400:kworker.0 00000100:00100000:0.0:1790919027.968403:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf6e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877914550312576:0@lo:400:kworker.0 00000100:00100000:2.0:1790919027.968801:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf6e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3306:1877914550312448:0@lo:400:kworker.0 00000100:00100000:2.0:1790919027.968847:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919027.968875:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf6e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1877914550312960:0@lo:400:kworker.0 00000100:00100000:2.0:1790919027.968899:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919027.968940:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790919027.968948:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf6e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550312832:0@lo:400:kworker.0 00000100:00100000:2.0:1790919027.968975:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790919027.969014:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919027.969035:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550312960 00000100:00100000:2.0:1790919027.969040:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550312960 00000100:00100000:2.0:1790919027.969092:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790919027.969099:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be85f38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877914550312960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919027.969141:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be85f38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877914550312960:12345-0@lo:400:kworker.0 Request processed in 43us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919027.969148:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790919027.969171:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550313088 00000100:00100000:2.0:1790919027.969175:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550313088 00000100:00100000:2.0:1790919027.969202:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550312832 00000100:00100000:2.0:1790919027.969206:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550312832 00000100:00100000:2.0:1790919027.969224:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790919027.969231:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550313088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919027.969269:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550313088:12345-0@lo:400:kworker.0 Request processed in 39us (1307us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919027.969277:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790919027.969288:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790919027.969293:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be85f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550312832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919027.969319:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be85f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550312832:12345-0@lo:400:kworker.0 Request processed in 26us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919027.969324:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790919027.969348:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550312448 00000100:00100000:2.0:1790919027.969351:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550312448 00000100:00100000:2.0:1790919027.969375:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1790919027.969382:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3306:x1877914550312448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919027.969410:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3306:x1877914550312448:12345-0@lo:400:kworker.0 Request processed in 29us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919027.969428:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00080000:2.0:1790919027.969465:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790919027.969469:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790919027.969472:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790919027.969497:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebf6e5c00 x1877914550312832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919027.969510:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf6e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550312832:0@lo:400:kworker.0 00000100:00100000:2.0:1790919027.969519:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf6e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3306:1877914550312448:0@lo:400:kworker.0 00000100:00100000:2.0:1790919027.969559:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf6e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1877914550312960:0@lo:400:kworker.0 00010000:00080000:2.0:1790919027.969595:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebf6e6a00 x1877914550313088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919027.969604:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf6e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550313088:0@lo:400:kworker.0 00000100:00100000:3.0:1790919028.481388:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb0b1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550313216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790919028.481482:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919028.481623:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550313216 00000100:00100000:1.0:1790919028.481633:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550313216 00000100:00100000:1.0:1790919028.481722:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790919028.481733:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550313216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790919028.481784:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919028.481844:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550313216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919028.481851:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1790919028.483004:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88beb0b1ed80 x1877914550313216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919044 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919028.483040:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb0b1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550313216:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790919028.993202:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919030.017623:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919030.478878:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919030.478944:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919030.479021:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532454784 00000100:00100000:0.0:1790919030.479042:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532454784 00000100:00100000:0.0:1790919030.479105:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 202 00000100:00100000:0.0:1790919030.479115:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+10:2353:x1877914532454784:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:0.0:1790919030.479184:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+10:2353:x1877914532454784:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 71us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919030.479191:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 202 00000100:00100000:2.0:1790919030.480181:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532454912 00000100:00100000:2.0:1790919030.480190:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532454912 00000100:00100000:2.0:1790919030.480259:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 51 00000100:00100000:2.0:1790919030.480269:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2353:x1877914532454912:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:2.0:1790919030.480327:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2353:x1877914532454912:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 60us (1457us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919030.480334:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 51 00000100:00080000:0.0:1790919030.480513:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790919030.527771:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790919030.527797:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb0b1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550313344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790919030.527874:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919030.527955:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550313344 00000100:00100000:1.0:1790919030.527964:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550313344 00000100:00100000:1.0:1790919030.528284:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790919030.528296:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88db4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550313344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790919030.528331:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919030.528485:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88db4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550313344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 191us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919030.528492:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1790919030.528518:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790919030.528751:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88beb0b1ed80 x1877914550313344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919046 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919030.528782:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb0b1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550313344:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790919031.042121:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919032.066538:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919033.088807:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919033.089630:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebfbf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550313856:0@lo:400:kworker.0 00000100:00100000:2.0:1790919033.089704:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919033.089762:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1790919033.089769:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be85f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550313472:0@lo:400:kworker.0 00000100:00100000:2.0:1790919033.089797:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919033.089819:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebfbf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1877914550313984:0@lo:400:kworker.0 00000100:00100000:2.0:1790919033.089853:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919033.090062:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be85f3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877914550313600:0@lo:400:kworker.0 00000100:00100000:2.0:1790919033.090090:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919033.090116:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebfbf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550314112:0@lo:400:kworker.0 00000100:00100000:2.0:1790919033.090137:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919033.090407:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550313984 00000100:00100000:0.0:1790919033.090415:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550313984 00000100:00100000:0.0:1790919033.090472:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550313600 00000100:00100000:0.0:1790919033.090475:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550313600 00000100:00100000:0.0:1790919033.090494:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790919033.090503:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebfbf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877914550313984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919033.090992:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebfbf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877914550313984:12345-0@lo:400:kworker.0 Request processed in 489us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919033.091000:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790919033.091018:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790919033.091024:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebfbf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877914550313600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919033.091051:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebfbf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877914550313600:12345-0@lo:400:kworker.0 Request processed in 28us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919033.091067:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1790919033.091164:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790919033.091407:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be85f3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877914550313600:0@lo:400:kworker.0 00000100:00100000:2.0:1790919033.091421:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790919033.091428:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb0b1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1877914550313728:0@lo:400:kworker.0 00000100:00100000:2.0:1790919033.091454:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919033.091519:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550313728 00000100:00100000:1.0:1790919033.091523:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550313728 00000100:00100000:1.0:1790919033.091568:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790919033.091573:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebfbf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877914550313728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919033.091604:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebfbf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877914550313728:12345-0@lo:400:kworker.0 Request processed in 31us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919033.091610:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1790919033.091627:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790919033.091643:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb0b1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1877914550313728:0@lo:400:kworker.0 00000100:00100000:1.0:1790919033.093061:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebfbf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1877914550313984:0@lo:400:kworker.0 00000100:00100000:3.0:1790919033.093892:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550313856 00000100:00100000:3.0:1790919033.093902:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550313856 00000100:00100000:3.0:1790919033.093968:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550314112 00000100:00100000:3.0:1790919033.093984:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550314112 00000100:00100000:3.0:1790919033.094005:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790919033.094014:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebfbf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550313856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919033.094091:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebfbf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550313856:12345-0@lo:400:kworker.0 Request processed in 78us (4386us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919033.094098:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790919033.094114:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790919033.094120:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebfbf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550314112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919033.094155:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebfbf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550314112:12345-0@lo:400:kworker.0 Request processed in 35us (4016us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919033.094161:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1790919033.094204:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebfbf0000 x1877914550314112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919033.094216:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebfbf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550314112:0@lo:400:kworker.0 00000100:00080000:1.0:1790919033.094354:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790919033.094359:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790919033.094381:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebfbf2680 x1877914550313856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919033.094391:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebfbf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550313856:0@lo:400:kworker.0 00000100:00100000:3.0:1790919033.094960:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550313472 00000100:00100000:3.0:1790919033.094966:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550313472 00000100:00100000:3.0:1790919033.095046:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1790919033.095055:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3305:x1877914550313472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919033.095101:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3305:x1877914550313472:12345-0@lo:400:kworker.0 Request processed in 47us (5303us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919033.095107:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1790919033.101088:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be85f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550313472:0@lo:400:kworker.0 00000100:00100000:1.0:1790919033.605400:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790919033.605423:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550314240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790919033.605491:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919033.605568:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550314240 00000100:00100000:1.0:1790919033.605575:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550314240 00000100:00100000:1.0:1790919033.605620:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790919033.605629:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88db4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550314240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790919033.605666:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919033.605719:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88db4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550314240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919033.605727:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1790919033.605768:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88be88db5180 x1877914550314240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919049 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919033.605786:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550314240:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790919034.118408:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919035.138569:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919035.601698:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919035.601741:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919035.601840:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532455040 00000100:00100000:2.0:1790919035.601850:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532455040 00000100:00100000:2.0:1790919035.601909:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 204 00000100:00100000:2.0:1790919035.601919:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+10:2351:x1877914532455040:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:2.0:1790919035.602112:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+10:2351:x1877914532455040:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 194us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919035.602120:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 204 00000100:00100000:1.0:1790919035.602688:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532455168 00000100:00100000:1.0:1790919035.602694:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532455168 00000100:00100000:1.0:1790919035.602741:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 55 00000100:00100000:1.0:1790919035.602750:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2351:x1877914532455168:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:1.0:1790919035.602795:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2351:x1877914532455168:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 47us (1053us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919035.602815:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 55 00000100:00080000:3.0:1790919035.603194:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790919035.662762:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550314368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790919035.662853:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919035.662925:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550314368 00000100:00100000:3.0:1790919035.662933:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550314368 00000100:00100000:3.0:1790919035.664670:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790919035.664683:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550314368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790919035.664720:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919035.664787:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550314368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (1934us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919035.664794:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1790919035.664854:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebac5ce00 x1877914550314368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919051 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919035.664872:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550314368:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790919035.665690:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790919036.160634:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919037.186993:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919038.207809:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919038.210963:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb0b1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550314880:0@lo:400:kworker.0 00000100:00100000:1.0:1790919038.211043:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919038.211098:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1790919038.211105:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550314496:0@lo:400:kworker.0 00000100:00100000:1.0:1790919038.211133:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919038.211156:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd82802300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1877914550315008:0@lo:400:kworker.0 00000100:00100000:1.0:1790919038.211358:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919038.211390:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877914550314624:0@lo:400:kworker.0 00000100:00100000:1.0:1790919038.211415:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919038.211441:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd82800380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550315136:0@lo:400:kworker.0 00000100:00100000:1.0:1790919038.211464:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919038.211483:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790919038.211489:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1877914550314752:0@lo:400:kworker.0 00000100:00100000:1.0:1790919038.211507:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919038.211558:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550314880 00000100:00100000:1.0:1790919038.211566:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550314880 00000100:00100000:1.0:1790919038.211618:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550315136 00000100:00100000:1.0:1790919038.211621:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550315136 00000100:00100000:1.0:1790919038.211642:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790919038.211650:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd82803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550314880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919038.211705:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd82803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550314880:12345-0@lo:400:kworker.0 Request processed in 55us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919038.211713:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790919038.211815:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790919038.211823:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd82801180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550315136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919038.211860:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd82801180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550315136:12345-0@lo:400:kworker.0 Request processed in 37us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919038.211865:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790919038.211884:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550314496 00000100:00100000:1.0:1790919038.211887:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550314496 00000100:00100000:1.0:1790919038.211914:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1790919038.211921:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3305:x1877914550314496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919038.211950:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3305:x1877914550314496:12345-0@lo:400:kworker.0 Request processed in 30us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919038.211957:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1790919038.211982:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550315008 00000100:00100000:1.0:1790919038.211992:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550315008 00000100:00100000:1.0:1790919038.212177:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550314624 00000100:00100000:1.0:1790919038.212180:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550314624 00000100:00080000:0.0:1790919038.213695:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790919038.213702:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790919038.213705:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790919038.214504:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550314752 00000100:00100000:2.0:1790919038.214514:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550314752 00000100:00100000:2.0:1790919038.214588:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790919038.214597:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd82801500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877914550315008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919038.214681:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd82801500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877914550315008:12345-0@lo:400:kworker.0 Request processed in 85us (3323us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919038.214689:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790919038.214707:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790919038.214714:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd82800700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877914550314624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919038.214768:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd82800700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877914550314624:12345-0@lo:400:kworker.0 Request processed in 55us (3352us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919038.214774:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790919038.214786:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790919038.214793:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd82800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877914550314752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919038.214821:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd82800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877914550314752:12345-0@lo:400:kworker.0 Request processed in 29us (3313us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919038.214827:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1790919038.214963:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790919038.215480:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1877914550314752:0@lo:400:kworker.0 00000100:00100000:1.0:1790919038.215494:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877914550314624:0@lo:400:kworker.0 00010000:00080000:1.0:1790919038.215508:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bd82800380 x1877914550315136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919038.215519:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd82800380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550315136:0@lo:400:kworker.0 00000100:00100000:1.0:1790919038.215583:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550314496:0@lo:400:kworker.0 00000100:00100000:1.0:1790919038.215594:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd82802300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1877914550315008:0@lo:400:kworker.0 00010000:00080000:1.0:1790919038.215604:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88beb0b1ed80 x1877914550314880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919038.215613:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb0b1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550314880:0@lo:400:kworker.0 00000100:00100000:3.0:1790919038.719785:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790919038.719806:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd82802300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550315264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790919038.719866:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919038.720055:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550315264 00000100:00100000:1.0:1790919038.720064:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550315264 00000100:00100000:1.0:1790919038.720112:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790919038.720120:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550315264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790919038.720153:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919038.720200:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550315264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919038.720206:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1790919038.720301:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bd82802300 x1877914550315264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919054 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919038.720318:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd82802300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550315264:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790919039.231852:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919040.255817:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919040.720910:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919040.720958:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919040.721019:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532455424 00000100:00100000:1.0:1790919040.721030:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532455424 00000100:00100000:1.0:1790919040.721102:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 59 00000100:00100000:1.0:1790919040.721123:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2351:x1877914532455424:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:1.0:1790919040.721197:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2351:x1877914532455424:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 76us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919040.721204:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 59 00000100:00080000:3.0:1790919040.721354:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790919040.722621:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532455296 00000100:00100000:2.0:1790919040.722633:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532455296 00000100:00100000:2.0:1790919040.722684:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 206 00000100:00100000:2.0:1790919040.722692:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+10:2351:x1877914532455296:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:2.0:1790919040.722767:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+10:2351:x1877914532455296:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 75us (1867us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919040.722775:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 206 00000100:00100000:3.0:1790919040.767997:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790919040.768023:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550315392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790919040.768099:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919040.768467:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550315392 00000100:00100000:2.0:1790919040.768476:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550315392 00000100:00100000:2.0:1790919040.768583:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790919040.768594:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550315392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790919040.768633:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790919040.768695:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550315392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919040.768702:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1790919040.768804:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790919040.768846:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebac5ca80 x1877914550315392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919056 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919040.768865:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550315392:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1790919040.975153:0:10140:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 01:30:40 (1790919040) === 00010000:00010000:1.0:1790919041.280138:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919041.405018:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919041.405142:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532455552 00000100:00100000:2.0:1790919041.405152:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532455552 00000100:00100000:2.0:1790919041.405212:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 207 00000100:00100000:2.0:1790919041.405222:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+10:8105:x1877914532455552:12345-192.168.201.27@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790919041.405240:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919041.405258:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be88387000/0xc3296956897c42f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8b413717672cb10 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919041.405287:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be88387000/0xc3296956897c42f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb10 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919041.405298:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be88387000/0xc3296956897c42f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb10 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919041.405305:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be88387000, rc 0) 00000100:00100000:2.0:1790919041.405521:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+11:8105:x1877914532455552:12345-192.168.201.27@tcp:101:mount.lustre.0 Request processed in 300us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919041.405560:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 207 00000100:00100000:3.0:1790919041.413973:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919041.414126:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532455680 00000100:00100000:1.0:1790919041.414136:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532455680 00000100:00100000:1.0:1790919041.414192:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 208 00000100:00100000:1.0:1790919041.414201:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+11:8105:x1877914532455680:12345-192.168.201.27@tcp:501:mount.lustre.0 00000100:00100000:1.0:1790919041.414613:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+11:8105:x1877914532455680:12345-192.168.201.27@tcp:501:mount.lustre.0 Request processed in 411us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919041.414621:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 208 00000100:00100000:3.0:1790919041.423742:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919041.424089:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532455808 00000100:00100000:2.0:1790919041.424101:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532455808 00000100:00100000:2.0:1790919041.424162:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 209 00000100:00100000:2.0:1790919041.424171:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+11:8105:x1877914532455808:12345-192.168.201.27@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790919041.424398:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+11:8105:x1877914532455808:12345-192.168.201.27@tcp:503:mount.lustre.0 Request processed in 228us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919041.424413:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 209 00000100:00100000:0.0:1790919041.435739:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919041.436233:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532455936 00000100:00100000:3.0:1790919041.436245:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532455936 00000100:00100000:3.0:1790919041.436313:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 210 00000100:00100000:3.0:1790919041.436323:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+11:8109:x1877914532455936:12345-192.168.201.27@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790919041.436663:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+11:8109:x1877914532455936:12345-192.168.201.27@tcp:502:llog_process_th.0 Request processed in 341us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919041.436671:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 210 00000100:00100000:3.0:1790919041.452145:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919041.452260:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532456064 00000100:00100000:1.0:1790919041.452270:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532456064 00000100:00100000:1.0:1790919041.452328:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 211 00000100:00100000:1.0:1790919041.452339:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+11:8109:x1877914532456064:12345-192.168.201.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790919041.452657:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+11:8109:x1877914532456064:12345-192.168.201.27@tcp:502:llog_process_th.0 Request processed in 318us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919041.452666:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 211 00000100:00100000:1.0:1790919041.465996:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919041.466475:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532456192 00000100:00100000:2.0:1790919041.466487:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532456192 00000100:00100000:2.0:1790919041.466577:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 212 00000100:00100000:2.0:1790919041.466587:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+11:8105:x1877914532456192:12345-192.168.201.27@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790919041.466603:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919041.466619:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be88386400/0xc3296956897c42fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8b413717672cb3a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919041.466646:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be88386400/0xc3296956897c42fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb3a expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919041.466657:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be88386400/0xc3296956897c42fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb3a expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919041.466665:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be88386400, rc 0) 00000100:00100000:2.0:1790919041.466728:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+12:8105:x1877914532456192:12345-192.168.201.27@tcp:101:mount.lustre.0 Request processed in 142us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919041.466734:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 212 00000100:00100000:0.0:1790919041.472103:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919041.472291:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532456320 00000100:00100000:3.0:1790919041.472302:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532456320 00000100:00100000:3.0:1790919041.472355:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 213 00000100:00100000:3.0:1790919041.472364:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+12:8105:x1877914532456320:12345-192.168.201.27@tcp:256:mount.lustre.0 20000000:01000000:3.0:1790919041.472390:0:5840:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1790919041.472418:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1790919041.472421:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1790919041.472425:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1790919041.472427:0:5840:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1790919041.486351:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+12:8105:x1877914532456320:12345-192.168.201.27@tcp:256:mount.lustre.0 Request processed in 13970us (14240us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919041.486372:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 213 00000100:00100000:1.0:1790919041.491001:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919041.494101:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532456448 00000100:00100000:3.0:1790919041.494119:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532456448 00000100:00100000:3.0:1790919041.494256:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 214 00000100:00100000:3.0:1790919041.494268:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+12:8105:x1877914532456448:12345-192.168.201.27@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790919041.494285:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919041.494304:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be81516600/0xc3296956897c4301 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8b413717672cb41 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919041.494334:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be81516600/0xc3296956897c4301 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb41 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919041.494346:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be81516600/0xc3296956897c4301 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb41 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919041.494355:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81516600, rc 0) 00000100:00100000:3.0:1790919041.494413:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+13:8105:x1877914532456448:12345-192.168.201.27@tcp:101:mount.lustre.0 Request processed in 147us (3424us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919041.494420:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 214 00000100:00100000:0.0:1790919041.502321:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919041.502402:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532456576 00000100:00100000:3.0:1790919041.502413:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532456576 00000100:00100000:3.0:1790919041.502557:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 215 00000100:00100000:3.0:1790919041.502568:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+13:8105:x1877914532456576:12345-192.168.201.27@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790919041.503287:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+13:8105:x1877914532456576:12345-192.168.201.27@tcp:501:mount.lustre.0 Request processed in 718us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919041.503298:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 215 00000100:00100000:0.0:1790919041.509302:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919041.509376:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532456704 00000100:00100000:3.0:1790919041.509387:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532456704 00000100:00100000:3.0:1790919041.509449:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 216 00000100:00100000:3.0:1790919041.509473:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+13:8105:x1877914532456704:12345-192.168.201.27@tcp:503:mount.lustre.0 00000100:00100000:3.0:1790919041.510118:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+13:8105:x1877914532456704:12345-192.168.201.27@tcp:503:mount.lustre.0 Request processed in 644us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919041.510128:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 216 00000100:00100000:1.0:1790919041.525560:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919041.525737:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532456832 00000100:00100000:3.0:1790919041.525748:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532456832 00000100:00100000:3.0:1790919041.525805:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 217 00000100:00100000:3.0:1790919041.525824:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+13:8112:x1877914532456832:12345-192.168.201.27@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790919041.526090:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+13:8112:x1877914532456832:12345-192.168.201.27@tcp:502:llog_process_th.0 Request processed in 275us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919041.526099:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 217 00000100:00100000:0.0:1790919041.528909:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919041.529043:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532456960 00000100:00100000:3.0:1790919041.529052:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532456960 00000100:00100000:3.0:1790919041.529111:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 218 00000100:00100000:3.0:1790919041.529121:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+13:8112:x1877914532456960:12345-192.168.201.27@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790919041.529361:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+13:8112:x1877914532456960:12345-192.168.201.27@tcp:502:llog_process_th.0 Request processed in 240us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919041.529370:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 218 00000100:00100000:0.0:1790919041.532191:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919041.532236:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919041.532330:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532457088 00000100:00100000:2.0:1790919041.532339:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532457088 00000100:00100000:2.0:1790919041.532381:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532457472 00000100:00100000:2.0:1790919041.532385:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532457472 00000100:00100000:2.0:1790919041.532427:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 60 00000100:00100000:2.0:1790919041.532442:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2350:x1877914532457472:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:2.0:1790919041.532518:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2350:x1877914532457472:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 82us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919041.532569:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 60 00000100:00100000:2.0:1790919041.532588:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 10 00000100:00100000:2.0:1790919041.532592:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2349:x1877914532457088:12345-192.168.201.27@tcp:38:mount.lustre.0 00010000:00080000:2.0:1790919041.532615:0:5847:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 5591729f-44f1-43f1-b042-c3a508737d97@192.168.201.27@tcp t0 exp 0000000000000000 cur 243 last 0 00000020:00000080:2.0:1790919041.532650:0:5847:0:(genops.c:1384:class_connect()) connect: client 5591729f-44f1-43f1-b042-c3a508737d97, cookie 0xc3296956897c4308 00000004:00100000:2.0:1790919041.532682:0:5847:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1790919041.533021:0:5847:0:(import.c:65:import_set_state_nolock()) ffff88bebf7d4800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790919041.533053:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5591729f-44f1-43f1-b042-c3a508737d97+6:2349:x1877914532457088:12345-192.168.201.27@tcp:38:mount.lustre.0 Request processed in 459us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919041.533060:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 10 00000100:00100000:1.0:1790919041.546769:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919041.546822:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919041.548086:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532457216 00000100:00100000:2.0:1790919041.548098:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532457216 00000100:00100000:3.0:1790919041.548201:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532457344 00000100:00100000:3.0:1790919041.548206:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532457344 00000100:00100000:2.0:1790919041.548210:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 11 00000100:00100000:2.0:1790919041.548219:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd82800380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5591729f-44f1-43f1-b042-c3a508737d97+7:0:x1877914532457216:12345-192.168.201.27@tcp:41:mount.lustre.0 00000100:00100000:3.0:1790919041.548230:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 12 00000100:00100000:3.0:1790919041.548235:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd82802300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5591729f-44f1-43f1-b042-c3a508737d97+7:8105:x1877914532457344:12345-192.168.201.27@tcp:41:mount.lustre.0 00000004:00000024:3.0:1790919041.548260:0:5845:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000004:00000024:2.0:1790919041.548260:0:5847:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1790919041.550059:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd82802300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5591729f-44f1-43f1-b042-c3a508737d97+7:8105:x1877914532457344:12345-192.168.201.27@tcp:41:mount.lustre.0 Request processed in 1813us (3226us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919041.550089:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 12 00000100:00100000:3.0:1790919041.556709:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919041.556774:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532457600 00000100:00100000:3.0:1790919041.556783:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532457600 00000100:00080000:0.0:1790919041.556806:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790919041.558656:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd82800380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5591729f-44f1-43f1-b042-c3a508737d97+7:0:x1877914532457216:12345-192.168.201.27@tcp:41:mount.lustre.0 Request processed in 10429us (11888us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919041.558669:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 11 00000100:00100000:2.0:1790919041.565944:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 13 00000100:00100000:2.0:1790919041.565960:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5591729f-44f1-43f1-b042-c3a508737d97+6:8105:x1877914532457600:12345-192.168.201.27@tcp:40:mount.lustre.0 00000100:00100000:2.0:1790919041.566063:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5591729f-44f1-43f1-b042-c3a508737d97+6:8105:x1877914532457600:12345-192.168.201.27@tcp:40:mount.lustre.0 Request processed in 108us (9376us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919041.566070:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 13 00000100:00100000:3.0:1790919041.578660:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919041.578722:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919041.578815:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919041.578869:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532457984 00000100:00100000:0.0:1790919041.578879:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532457984 00000100:00100000:0.0:1790919041.578941:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 1 00000100:00100000:0.0:1790919041.578951:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5591729f-44f1-43f1-b042-c3a508737d97+6:8105:x1877914532457984:12345-192.168.201.27@tcp:33:mount.lustre.0 00000004:00200000:0.0:1790919041.579025:0:5848:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1790919041.579106:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5591729f-44f1-43f1-b042-c3a508737d97+6:8105:x1877914532457984:12345-192.168.201.27@tcp:33:mount.lustre.0 Request processed in 156us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919041.579114:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 1 00000100:00100000:1.0:1790919041.584467:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532457728 00000100:00100000:1.0:1790919041.584496:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532457728 00000100:00100000:1.0:1790919041.584702:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532457856 00000100:00100000:1.0:1790919041.584707:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532457856 00000100:00100000:1.0:1790919041.584730:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 12 00000100:00100000:1.0:1790919041.584738:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2349:x1877914532457728:12345-192.168.201.27@tcp:8:mount.lustre.0 00010000:00080000:1.0:1790919041.584768:0:6698:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 5591729f-44f1-43f1-b042-c3a508737d97@192.168.201.27@tcp t0 exp 0000000000000000 cur 243 last 0 00000020:00000080:1.0:1790919041.584798:0:6698:0:(genops.c:1384:class_connect()) connect: client 5591729f-44f1-43f1-b042-c3a508737d97, cookie 0xc3296956897c430f 00002000:00100000:1.0:1790919041.584810:0:6698:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5591729f-44f1-43f1-b042-c3a508737d97/ffff88be87135000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790919041.584821:0:6698:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790919041.585044:0:6698:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1790919041.585075:0:6698:0:(import.c:65:import_set_state_nolock()) ffff88be87136800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790919041.585140:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5591729f-44f1-43f1-b042-c3a508737d97+6:2349:x1877914532457728:12345-192.168.201.27@tcp:8:mount.lustre.0 Request processed in 402us (6417us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919041.585148:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 12 00000100:00100000:1.0:1790919041.585166:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 13 00000100:00100000:1.0:1790919041.585171:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2349:x1877914532457856:12345-192.168.201.27@tcp:8:mount.lustre.0 00010000:00080000:1.0:1790919041.585188:0:6698:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 5591729f-44f1-43f1-b042-c3a508737d97@192.168.201.27@tcp t0 exp 0000000000000000 cur 243 last 0 00000020:00000080:1.0:1790919041.585204:0:6698:0:(genops.c:1384:class_connect()) connect: client 5591729f-44f1-43f1-b042-c3a508737d97, cookie 0xc3296956897c4316 00002000:00100000:1.0:1790919041.585209:0:6698:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5591729f-44f1-43f1-b042-c3a508737d97/ffff88be87131000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790919041.585225:0:6698:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790919041.585846:0:6698:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1790919041.585864:0:6698:0:(import.c:65:import_set_state_nolock()) ffff88be87135800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790919041.585982:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5591729f-44f1-43f1-b042-c3a508737d97+6:2349:x1877914532457856:12345-192.168.201.27@tcp:8:mount.lustre.0 Request processed in 808us (7166us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919041.585991:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 13 00010000:00010000:0.0:1790919042.303772:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919043.327862:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf6e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877914550315648:0@lo:400:kworker.0 00000100:00100000:0.0:1790919043.327940:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919043.328049:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf6e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550316160:0@lo:400:kworker.0 00000100:00100000:0.0:1790919043.328078:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919043.328122:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790919043.328129:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf6e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1877914550315776:0@lo:400:kworker.0 00000100:00100000:2.0:1790919043.328363:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf6e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550315904:0@lo:400:kworker.0 00000100:00100000:2.0:1790919043.328407:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919043.328431:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1790919043.328437:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf6e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550315520:0@lo:400:kworker.0 00000100:00100000:2.0:1790919043.328463:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919043.328485:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf6e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1877914550316032:0@lo:400:kworker.0 00000100:00100000:2.0:1790919043.328508:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919043.328583:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550316160 00000100:00100000:2.0:1790919043.328590:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550316160 00000100:00100000:2.0:1790919043.328644:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550315904 00000100:00100000:2.0:1790919043.328648:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550315904 00000100:00100000:2.0:1790919043.328680:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790919043.328690:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88d99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550316160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919043.328741:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88d99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550316160:12345-0@lo:400:kworker.0 Request processed in 53us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919043.328749:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790919043.328767:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790919043.328774:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebfbf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550315904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919043.328806:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebfbf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550315904:12345-0@lo:400:kworker.0 Request processed in 33us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919043.328811:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790919043.328829:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550315520 00000100:00100000:2.0:1790919043.328833:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550315520 00000100:00100000:2.0:1790919043.328858:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1790919043.328864:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3305:x1877914550315520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919043.328894:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3305:x1877914550315520:12345-0@lo:400:kworker.0 Request processed in 30us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919043.328907:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1790919043.328936:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550315648 00000100:00100000:2.0:1790919043.328940:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550315648 00000100:00100000:2.0:1790919043.328963:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550316032 00000100:00100000:2.0:1790919043.328966:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550316032 00000100:00100000:2.0:1790919043.328983:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790919043.328989:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877914550315648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919043.329021:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877914550315648:12345-0@lo:400:kworker.0 Request processed in 31us (1082us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919043.329027:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790919043.329038:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790919043.329044:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebfbf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877914550316032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919043.329071:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebfbf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877914550316032:12345-0@lo:400:kworker.0 Request processed in 28us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919043.329077:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1790919043.329092:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790919043.329096:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790919043.329098:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790919043.329131:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf6e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550315520:0@lo:400:kworker.0 00000100:00100000:2.0:1790919043.329143:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf6e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1877914550316032:0@lo:400:kworker.0 00010000:00080000:2.0:1790919043.329154:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebf6e6a00 x1877914550315904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919043.329164:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf6e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550315904:0@lo:400:kworker.0 00000100:00100000:0.0:1790919043.329589:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919043.329625:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf6e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877914550315648:0@lo:400:kworker.0 00010000:00080000:0.0:1790919043.329636:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebf6e4e00 x1877914550316160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919043.329645:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf6e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550316160:0@lo:400:kworker.0 00000100:00100000:0.0:1790919043.329680:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550315776 00000100:00100000:0.0:1790919043.329685:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550315776 00000100:00100000:0.0:1790919043.329712:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790919043.329718:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebacb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877914550315776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919043.329754:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebacb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877914550315776:12345-0@lo:400:kworker.0 Request processed in 36us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919043.329760:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790919043.329819:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf6e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1877914550315776:0@lo:400:kworker.0 00010000:00010000:1.0:1790919043.329904:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790919043.330518:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790919043.842731:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550316288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790919043.842816:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919043.842890:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550316288 00000100:00100000:3.0:1790919043.842897:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550316288 00000100:00100000:3.0:1790919043.842942:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790919043.842951:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550316288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790919043.842987:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919043.843030:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550316288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919043.843037:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1790919043.843090:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebac5e680 x1877914550316288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919059 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919043.843121:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550316288:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790919044.353609:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1790919044.937100:0:5869:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5591729f-44f1-43f1-b042-c3a508737d97 00000001:00100000:1.0:1790919044.978177:0:7662:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5591729f-44f1-43f1-b042-c3a508737d97 00010000:00010000:0.0:1790919045.377005:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790919045.433184:0:6722:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5591729f-44f1-43f1-b042-c3a508737d97 00000100:00100000:2.0:1790919045.887796:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550316416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790919045.887869:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919045.888000:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550316416 00000100:00100000:3.0:1790919045.888010:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550316416 00000100:00100000:3.0:1790919045.888074:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790919045.888085:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebfbf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550316416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790919045.888118:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919045.888197:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebfbf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550316416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919045.888204:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1790919045.888272:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790919045.888441:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebac5e680 x1877914550316416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919061 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919045.888460:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550316416:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790919046.399972:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919046.862389:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919046.862440:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919046.862467:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919046.862495:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919046.862548:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919046.862591:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532458368 00000100:00100000:0.0:1790919046.862611:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532458368 00000100:00100000:0.0:1790919046.862666:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532458240 00000100:00100000:0.0:1790919046.862670:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532458240 00000100:00100000:0.0:1790919046.862693:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 64 00000100:00100000:0.0:1790919046.862702:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebacb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5591729f-44f1-43f1-b042-c3a508737d97+5:2351:x1877914532458368:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:0.0:1790919046.862773:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebacb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5591729f-44f1-43f1-b042-c3a508737d97+5:2351:x1877914532458368:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 72us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919046.862780:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 64 00000100:00100000:0.0:1790919046.862797:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 65 00000100:00100000:0.0:1790919046.862803:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebacb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2351:x1877914532458240:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:0.0:1790919046.862829:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebacb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2351:x1877914532458240:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 26us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919046.862835:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 65 00000100:00100000:3.0:1790919046.863744:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532458112 00000100:00100000:3.0:1790919046.863752:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532458112 00000100:00100000:3.0:1790919046.863796:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 220 00000100:00100000:3.0:1790919046.863805:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+13:2351:x1877914532458112:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1790919046.863841:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+13:2351:x1877914532458112:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 38us (1463us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919046.863848:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 220 00000100:00080000:3.0:1790919046.864007:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790919046.864032:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532458624 00000100:00100000:3.0:1790919046.864037:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532458624 00000100:00100000:3.0:1790919046.864069:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532458496 00000100:00100000:3.0:1790919046.864072:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532458496 00000100:00100000:3.0:1790919046.864087:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 35 00000100:00100000:3.0:1790919046.864093:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebacb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5591729f-44f1-43f1-b042-c3a508737d97+5:2351:x1877914532458624:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1790919046.864206:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebacb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5591729f-44f1-43f1-b042-c3a508737d97+5:2351:x1877914532458624:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 112us (1738us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919046.864212:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 35 00000100:00100000:3.0:1790919046.864235:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 36 00000100:00100000:3.0:1790919046.864243:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebacb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5591729f-44f1-43f1-b042-c3a508737d97+5:2351:x1877914532458496:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1790919046.864267:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebacb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5591729f-44f1-43f1-b042-c3a508737d97+5:2351:x1877914532458496:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 26us (1720us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919046.864274:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 36 00000100:00080000:3.0:1790919046.864343:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790919046.864355:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1790919047.424821:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790919047.476833:0:10335:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg127-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1790919048.451223:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919048.457489:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb0b1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3306:1877914550316544:0@lo:400:kworker.0 00000100:00100000:1.0:1790919048.457584:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877914550316672:0@lo:400:kworker.0 00000100:00100000:3.0:1790919048.457604:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919048.457671:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550316928:0@lo:400:kworker.0 00000100:00100000:0.0:1790919048.457756:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1877914550316800:0@lo:400:kworker.0 00000100:00100000:1.0:1790919048.458000:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919048.458047:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf789880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550317184:0@lo:400:kworker.0 00000100:00100000:1.0:1790919048.458073:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919048.458117:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550316672 00000100:00100000:1.0:1790919048.458124:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550316672 00000100:00100000:1.0:1790919048.458170:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790919048.458178:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf78ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877914550316672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919048.458230:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf78ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877914550316672:12345-0@lo:400:kworker.0 Request processed in 52us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919048.458237:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790919048.458279:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877914550316672:0@lo:400:kworker.0 00000100:00100000:2.0:1790919048.461015:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919048.461092:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790919048.461103:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf788e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1877914550317056:0@lo:400:kworker.0 00000100:00100000:2.0:1790919048.461142:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919048.464517:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550317184 00000100:00100000:3.0:1790919048.464543:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550317184 00000100:00100000:0.0:1790919048.465508:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919048.465569:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550316928 00000100:00100000:3.0:1790919048.465587:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550316928 00000100:00100000:3.0:1790919048.465611:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790919048.465620:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf788a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550317184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919048.469126:0:6698:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1790919048.469147:0:6698:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1790919048.469602:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf788a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550317184:12345-0@lo:400:kworker.0 Request processed in 3978us (11523us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919048.469614:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790919048.469645:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790919048.469657:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebfbf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550316928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919048.469846:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebfbf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550316928:12345-0@lo:400:kworker.0 Request processed in 193us (8838us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919048.469853:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790919048.469882:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550317056 00000100:00100000:3.0:1790919048.469889:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550317056 00000100:00100000:3.0:1790919048.469922:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550316800 00000100:00100000:3.0:1790919048.469924:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550316800 00000100:00100000:3.0:1790919048.469940:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790919048.469945:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebfbf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877914550317056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919048.469973:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebfbf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877914550317056:12345-0@lo:400:kworker.0 Request processed in 28us (8831us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919048.469979:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790919048.469997:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790919048.470002:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebacb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877914550316800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919048.470027:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebacb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877914550316800:12345-0@lo:400:kworker.0 Request processed in 26us (4524us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919048.470032:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1790919048.470045:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790919048.470050:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790919048.470052:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1790919048.470091:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebf789880 x1877914550317184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919048.470105:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf789880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550317184:0@lo:400:kworker.0 00000100:00100000:3.0:1790919048.470142:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf788e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1877914550317056:0@lo:400:kworker.0 00010000:00080000:3.0:1790919048.470153:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88be88db7100 x1877914550316928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919048.470161:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550316928:0@lo:400:kworker.0 00000100:00100000:3.0:1790919048.470282:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550316544 00000100:00100000:3.0:1790919048.470286:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550316544 00000100:00100000:0.0:1790919048.470698:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1877914550316800:0@lo:400:kworker.0 00000100:00100000:2.0:1790919048.472466:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1790919048.472484:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3306:x1877914550316544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919048.472757:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3306:x1877914550316544:12345-0@lo:400:kworker.0 Request processed in 279us (15154us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919048.472765:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1790919048.472844:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb0b1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3306:1877914550316544:0@lo:400:kworker.0 00000100:00100000:2.0:1790919048.960390:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790919048.960412:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550317312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790919048.960477:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919048.960688:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550317312 00000100:00100000:1.0:1790919048.960696:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550317312 00000100:00100000:1.0:1790919048.960752:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790919048.960761:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebfbf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550317312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790919048.960797:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919048.960843:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebfbf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550317312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919048.960850:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1790919048.960866:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebac5c000 x1877914550317312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919064 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919048.960886:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550317312:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790919049.475868:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919050.496384:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919051.012883:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550317440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790919051.012980:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919051.013078:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550317440 00000100:00100000:1.0:1790919051.013088:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550317440 00000100:00080000:0.0:1790919051.014620:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790919051.016199:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790919051.016224:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf789f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550317440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790919051.016282:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919051.016408:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf789f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550317440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 194us (3427us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919051.016417:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1790919051.016466:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebac5c000 x1877914550317440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919067 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919051.016494:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550317440:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790919051.522080:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919051.987644:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919051.987766:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532458752 00000100:00100000:2.0:1790919051.987776:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532458752 00000100:00100000:2.0:1790919051.987837:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 222 00000100:00100000:2.0:1790919051.987847:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+13:2350:x1877914532458752:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:2.0:1790919051.991861:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+13:2350:x1877914532458752:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 4002us (4224us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919051.994613:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 222 00000100:00100000:0.0:1790919051.995688:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919051.995736:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919051.995773:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919051.995805:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919051.995841:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532459264 00000100:00100000:0.0:1790919051.995850:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532459264 00000100:00100000:0.0:1790919051.995913:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532459136 00000100:00100000:0.0:1790919051.995929:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532459136 00000100:00100000:0.0:1790919051.995957:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 39 00000100:00100000:0.0:1790919051.995966:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebacb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5591729f-44f1-43f1-b042-c3a508737d97+5:2350:x1877914532459264:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:0.0:1790919051.996036:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebacb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5591729f-44f1-43f1-b042-c3a508737d97+5:2350:x1877914532459264:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 71us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919051.996214:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532459008 00000100:00100000:3.0:1790919051.996226:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532459008 00000100:00100000:3.0:1790919051.996267:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532458880 00000100:00100000:3.0:1790919051.996271:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532458880 00000100:00100000:3.0:1790919051.996294:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 69 00000100:00100000:3.0:1790919051.996301:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebacb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5591729f-44f1-43f1-b042-c3a508737d97+5:2350:x1877914532459008:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1790919051.996334:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebacb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5591729f-44f1-43f1-b042-c3a508737d97+5:2350:x1877914532459008:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 34us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919051.996340:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 69 00000100:00100000:3.0:1790919051.996357:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 70 00000100:00100000:3.0:1790919051.996363:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebacb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2350:x1877914532458880:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1790919051.996388:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebacb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2350:x1877914532458880:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 25us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919051.996394:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 70 00000100:00080000:3.0:1790919051.996571:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790919051.996576:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790919051.996578:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790919051.997069:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 39 00000100:00100000:1.0:1790919052.005362:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 40 00000100:00100000:1.0:1790919052.005388:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebacb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5591729f-44f1-43f1-b042-c3a508737d97+5:2350:x1877914532459136:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:1.0:1790919052.005485:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebacb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5591729f-44f1-43f1-b042-c3a508737d97+5:2350:x1877914532459136:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 109us (9678us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919052.005494:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 40 00010000:00010000:2.0:1790919052.547781:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919053.567964:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebacb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1877914550317824:0@lo:400:kworker.0 00000100:00100000:0.0:1790919053.568037:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919053.568111:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1790919053.568126:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebacb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877914550317696:0@lo:400:kworker.0 00000100:00100000:3.0:1790919053.568265:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebacb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550317952:0@lo:400:kworker.0 00000100:00100000:3.0:1790919053.568296:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919053.568324:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1790919053.568330:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebacb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550317568:0@lo:400:kworker.0 00000100:00100000:3.0:1790919053.568354:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919053.568373:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebacb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1877914550318080:0@lo:400:kworker.0 00000100:00100000:3.0:1790919053.568392:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919053.568421:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550317824 00000100:00100000:3.0:1790919053.568428:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550317824 00000100:00100000:3.0:1790919053.568475:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550318080 00000100:00100000:3.0:1790919053.568477:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550318080 00000100:00100000:3.0:1790919053.568552:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790919053.568561:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebacb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877914550317824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919053.568608:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebacb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877914550317824:12345-0@lo:400:kworker.0 Request processed in 48us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919053.568616:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790919053.568643:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790919053.568649:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877914550318080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919053.568679:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877914550318080:12345-0@lo:400:kworker.0 Request processed in 30us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919053.568685:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790919053.568703:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550317952 00000100:00100000:3.0:1790919053.568706:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550317952 00000100:00100000:3.0:1790919053.568731:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790919053.568736:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550317952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919053.568765:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550317952:12345-0@lo:400:kworker.0 Request processed in 28us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919053.568770:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790919053.568787:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550317568 00000100:00100000:3.0:1790919053.568790:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550317568 00000100:00100000:3.0:1790919053.568810:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1790919053.568815:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3305:x1877914550317568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919053.568841:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3305:x1877914550317568:12345-0@lo:400:kworker.0 Request processed in 26us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919053.568847:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00080000:3.0:1790919053.568874:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790919053.568879:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790919053.568917:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebacb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550317568:0@lo:400:kworker.0 00000100:00100000:3.0:1790919053.568940:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebacb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1877914550318080:0@lo:400:kworker.0 00010000:00080000:3.0:1790919053.568950:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebacb0700 x1877914550317952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919053.568959:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebacb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550317952:0@lo:400:kworker.0 00000100:00100000:0.0:1790919053.569615:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919053.569778:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebacb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550318208:0@lo:400:kworker.0 00000100:00100000:3.0:1790919053.569883:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550317696 00000100:00100000:3.0:1790919053.569889:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550317696 00000100:00100000:3.0:1790919053.569915:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790919053.569922:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebacb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877914550317696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919053.571600:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebacb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877914550317696:12345-0@lo:400:kworker.0 Request processed in 1672us (1981us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919053.571611:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790919053.575329:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919053.575408:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebacb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1877914550317824:0@lo:400:kworker.0 00000100:00100000:0.0:1790919053.575437:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebacb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877914550317696:0@lo:400:kworker.0 00010000:00010000:1.0:1790919053.575913:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919053.576264:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550318208 00000100:00100000:2.0:1790919053.576273:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550318208 00000100:00100000:2.0:1790919053.576355:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790919053.576366:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0a5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550318208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919053.576452:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0a5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550318208:12345-0@lo:400:kworker.0 Request processed in 88us (1131us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919053.576459:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1790919053.576791:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebacb1180 x1877914550318208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919053.576815:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebacb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550318208:0@lo:400:kworker.0 00000100:00080000:3.0:1790919053.577600:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790919054.082564:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790919054.082597:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf78b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550318336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790919054.082698:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919054.082836:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550318336 00000100:00100000:1.0:1790919054.082846:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550318336 00000100:00100000:1.0:1790919054.082932:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790919054.082944:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebfbf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550318336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790919054.083182:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919054.083253:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebfbf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550318336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 309us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919054.083273:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1790919054.083356:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebf78b480 x1877914550318336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919070 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919054.083380:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf78b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550318336:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790919054.592331:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919055.616347:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919056.140093:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790919056.140126:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf789500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550318464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790919056.140223:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919056.148368:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550318464 00000100:00100000:3.0:1790919056.148392:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550318464 00000100:00100000:3.0:1790919056.148504:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790919056.148517:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf78b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550318464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790919056.148603:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1790919056.148992:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790919056.149054:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf78b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550318464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 538us (8829us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919056.149063:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1790919056.149126:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebf789500 x1877914550318464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919072 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919056.149153:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf789500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550318464:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790919056.640041:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919057.107876:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919057.107958:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532459520 00000100:00100000:1.0:1790919057.107972:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532459520 00000100:00100000:1.0:1790919057.108111:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 74 00000100:00100000:1.0:1790919057.108127:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebacb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2350:x1877914532459520:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:1.0:1790919057.108234:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebacb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2350:x1877914532459520:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 112us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919057.108242:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 74 00000100:00100000:0.0:1790919057.108287:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919057.108398:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532459776 00000100:00080000:2.0:1790919057.108861:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790919057.112851:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532459776 00000100:00080000:2.0:1790919057.112931:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790919057.113345:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 43 00000100:00100000:0.0:1790919057.113446:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919057.113512:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919057.113586:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919057.113611:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532459392 00000100:00100000:2.0:1790919057.113622:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532459392 00000100:00100000:2.0:1790919057.113695:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 224 00000100:00100000:2.0:1790919057.113705:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+13:2350:x1877914532459392:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:2.0:1790919057.113795:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+13:2350:x1877914532459392:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 93us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919057.113803:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 224 00000100:00100000:2.0:1790919057.113853:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532459904 00000100:00100000:2.0:1790919057.113856:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532459904 00000100:00100000:2.0:1790919057.113884:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 44 00000100:00100000:2.0:1790919057.113889:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebacb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5591729f-44f1-43f1-b042-c3a508737d97+5:2350:x1877914532459904:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:2.0:1790919057.113912:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebacb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5591729f-44f1-43f1-b042-c3a508737d97+5:2350:x1877914532459904:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 24us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919057.113917:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 44 00000100:00080000:2.0:1790919057.113929:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790919057.114070:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532459648 00000100:00100000:1.0:1790919057.114075:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532459648 00000100:00100000:1.0:1790919057.114130:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 75 00000100:00100000:1.0:1790919057.114139:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebacb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5591729f-44f1-43f1-b042-c3a508737d97+5:2350:x1877914532459648:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1790919057.114173:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebacb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5591729f-44f1-43f1-b042-c3a508737d97+5:2350:x1877914532459776:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:1.0:1790919057.114175:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebacb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5591729f-44f1-43f1-b042-c3a508737d97+5:2350:x1877914532459648:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 37us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919057.114187:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 75 00000100:00100000:3.0:1790919057.114221:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebacb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5591729f-44f1-43f1-b042-c3a508737d97+5:2350:x1877914532459776:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 865us (5934us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919057.114230:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 43 00000100:00080000:2.0:1790919057.114726:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790919057.671924:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919058.688369:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebacb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550318976:0@lo:400:kworker.0 00000100:00100000:2.0:1790919058.688479:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919058.688578:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1790919058.688586:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebacb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550318592:0@lo:400:kworker.0 00000100:00100000:0.0:1790919058.688715:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebacb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1877914550318848:0@lo:400:kworker.0 00000100:00100000:0.0:1790919058.688772:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919058.688800:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1790919058.688807:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebacb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877914550318720:0@lo:400:kworker.0 00000100:00100000:0.0:1790919058.688839:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919058.688859:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebacb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550319232:0@lo:400:kworker.0 00000100:00100000:0.0:1790919058.688879:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919058.689066:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919058.689099:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebacb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1877914550319104:0@lo:400:kworker.0 00000100:00100000:2.0:1790919058.689122:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919058.689247:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550318848 00000100:00100000:0.0:1790919058.689257:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550318848 00010000:00010000:2.0:1790919058.689408:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919058.689421:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550318976 00000100:00100000:2.0:1790919058.689426:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550318976 00000100:00100000:2.0:1790919058.689472:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550319232 00000100:00100000:2.0:1790919058.689475:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550319232 00000100:00100000:2.0:1790919058.689501:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790919058.689711:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550318720 00000100:00100000:0.0:1790919058.689715:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550318720 00000100:00100000:0.0:1790919058.689729:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550319104 00000100:00100000:0.0:1790919058.689732:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550319104 00000100:00100000:0.0:1790919058.689748:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790919058.689756:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877914550318848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919058.689834:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877914550318848:12345-0@lo:400:kworker.0 Request processed in 79us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919058.689841:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790919058.689860:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790919058.689866:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877914550318720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919058.689981:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebfbf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550318976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919058.690061:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebfbf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550318976:12345-0@lo:400:kworker.0 Request processed in 551us (1582us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919058.690068:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790919058.690083:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790919058.690096:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550319232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919058.690127:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550319232:12345-0@lo:400:kworker.0 Request processed in 32us (1247us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919058.690133:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790919058.690166:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550318592 00000100:00100000:2.0:1790919058.690171:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550318592 00000100:00100000:2.0:1790919058.690197:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1790919058.690204:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3305:x1877914550318592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919058.690234:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3305:x1877914550318592:12345-0@lo:400:kworker.0 Request processed in 30us (1168us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919058.690239:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1790919058.690268:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790919058.690294:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebfbf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877914550319104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919058.690323:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebfbf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877914550319104:12345-0@lo:400:kworker.0 Request processed in 31us (1200us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919058.690328:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1790919058.690351:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790919058.690356:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790919058.690358:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790919058.690406:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebacb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550318592:0@lo:400:kworker.0 00000100:00100000:2.0:1790919058.690422:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebacb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1877914550319104:0@lo:400:kworker.0 00010000:00080000:2.0:1790919058.690436:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebacb0700 x1877914550318976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919058.690447:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebacb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550318976:0@lo:400:kworker.0 00000100:00100000:0.0:1790919058.691461:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877914550318720:12345-0@lo:400:kworker.0 Request processed in 1589us (2614us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919058.691473:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790919058.692033:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebacb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877914550318720:0@lo:400:kworker.0 00010000:00080000:0.0:1790919058.692049:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebacb1500 x1877914550319232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919058.692060:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebacb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550319232:0@lo:400:kworker.0 00000100:00100000:0.0:1790919058.692072:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebacb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1877914550318848:0@lo:400:kworker.0 00000100:00100000:0.0:1790919059.202793:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf78a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550319360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790919059.202927:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919059.203176:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550319360 00000100:00100000:3.0:1790919059.203187:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550319360 00000100:00100000:3.0:1790919059.203257:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790919059.203269:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550319360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790919059.203317:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919059.203382:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550319360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919059.203401:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1790919059.206000:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebf78a680 x1877914550319360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919075 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919059.206039:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf78a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550319360:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790919059.714245:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919060.744720:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919061.253200:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790919061.253231:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf788700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550319488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790919061.253336:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919061.253432:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550319488 00000100:00100000:1.0:1790919061.253443:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550319488 00000100:00100000:1.0:1790919061.254119:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790919061.254141:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf788000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550319488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790919061.254190:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919061.254251:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf788000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550319488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919061.254258:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1790919061.254291:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790919061.254944:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebf788700 x1877914550319488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919077 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919061.254971:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf788700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550319488:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790919061.761927:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919062.233466:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919062.233543:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919062.233569:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919062.233591:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919062.233615:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919062.233652:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532460032 00000100:00100000:3.0:1790919062.233662:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532460032 00000100:00100000:3.0:1790919062.233704:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 226 00000100:00100000:3.0:1790919062.233714:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+13:2351:x1877914532460032:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1790919062.233779:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+13:2351:x1877914532460032:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 66us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919062.233786:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 226 00000100:00100000:3.0:1790919062.233823:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532460160 00000100:00100000:3.0:1790919062.233827:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532460160 00000100:00100000:3.0:1790919062.233860:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532460288 00000100:00100000:3.0:1790919062.233863:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532460288 00000100:00100000:3.0:1790919062.233883:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 79 00000100:00100000:3.0:1790919062.233889:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2351:x1877914532460160:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1790919062.233923:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2351:x1877914532460160:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 34us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919062.233930:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 79 00000100:00100000:3.0:1790919062.233960:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 80 00000100:00100000:3.0:1790919062.233966:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5591729f-44f1-43f1-b042-c3a508737d97+5:2351:x1877914532460288:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1790919062.233991:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5591729f-44f1-43f1-b042-c3a508737d97+5:2351:x1877914532460288:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 25us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919062.233997:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 80 00000100:00080000:3.0:1790919062.234115:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790919062.234727:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532460416 00000100:00100000:3.0:1790919062.234734:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532460416 00000100:00100000:3.0:1790919062.234785:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532460544 00000100:00100000:3.0:1790919062.234789:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532460544 00000100:00100000:3.0:1790919062.234812:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 14 00000100:00100000:3.0:1790919062.234819:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5591729f-44f1-43f1-b042-c3a508737d97+5:2349:x1877914532460416:12345-192.168.201.27@tcp:9:kworker.0 00000020:00000080:3.0:1790919062.234841:0:6699:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3296956897c430f 00000100:00080000:3.0:1790919062.234850:0:6699:0:(import.c:65:import_set_state_nolock()) ffff88be87136800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1790919062.234859:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 15 00000100:00100000:0.0:1790919062.234868:0:10350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5591729f-44f1-43f1-b042-c3a508737d97+5:2349:x1877914532460544:12345-192.168.201.27@tcp:9:kworker.0 00000020:00000080:0.0:1790919062.234881:0:10350:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3296956897c4316 00000100:00080000:0.0:1790919062.234887:0:10350:0:(import.c:65:import_set_state_nolock()) ffff88be87135800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790919062.234888:0:6699:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000001:00000004:0.0:1790919062.234909:0:10350:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1790919062.235210:0:10350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5591729f-44f1-43f1-b042-c3a508737d97+2:2349:x1877914532460544:12345-192.168.201.27@tcp:9:kworker.0 Request processed in 341us (1591us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919062.235217:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 15 00010000:00010000:0.0:1790919062.235236:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919062.236066:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5591729f-44f1-43f1-b042-c3a508737d97+2:2349:x1877914532460416:12345-192.168.201.27@tcp:9:kworker.0 Request processed in 1114us (2340us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919062.236075:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 14 00000100:00080000:3.0:1790919062.236111:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790919062.236115:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790919062.236121:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919062.783781:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919063.811836:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919063.819042:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790919063.819077:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550319616:0@lo:400:kworker.0 00000100:00100000:3.0:1790919063.819159:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919063.819404:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550319616 00000100:00100000:3.0:1790919063.819412:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550319616 00000100:00100000:3.0:1790919063.819632:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1790919063.819646:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3305:x1877914550319616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919063.819703:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3305:x1877914550319616:12345-0@lo:400:kworker.0 Request processed in 62us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919063.822912:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1790919063.823014:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550319616:0@lo:400:kworker.0 00000100:00100000:3.0:1790919063.823340:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550320000:0@lo:400:kworker.0 00000100:00100000:3.0:1790919063.823399:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919063.823452:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790919063.823458:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1877914550320128:0@lo:400:kworker.0 00000100:00100000:3.0:1790919063.824277:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919063.824334:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550320128 00000100:00100000:3.0:1790919063.824342:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550320128 00000100:00100000:3.0:1790919063.824396:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1790919063.824405:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877914550320128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919063.824455:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877914550320128:12345-0@lo:400:kworker.0 Request processed in 51us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919063.824462:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:3.0:1790919063.824804:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790919063.824846:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1877914550320128:0@lo:400:kworker.0 00000100:00100000:0.0:1790919063.825371:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877914550319744:0@lo:400:kworker.0 00000100:00100000:0.0:1790919063.825415:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919063.825446:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550320256:0@lo:400:kworker.0 00000100:00100000:0.0:1790919063.825485:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919063.825510:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790919063.825518:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1877914550319872:0@lo:400:kworker.0 00000100:00100000:0.0:1790919063.825562:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919063.825596:0:10350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550320000 00000100:00100000:0.0:1790919063.825601:0:10350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550320000 00000100:00100000:0.0:1790919063.825636:0:10350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550320256 00000100:00100000:0.0:1790919063.825639:0:10350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550320256 00000100:00100000:0.0:1790919063.825661:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790919063.825692:0:10350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550320000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919063.825742:0:10350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550320000:12345-0@lo:400:kworker.0 Request processed in 51us (2343us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919063.825748:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790919063.825762:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790919063.825768:0:10350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550320256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919063.825799:0:10350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550320256:12345-0@lo:400:kworker.0 Request processed in 32us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919063.825805:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790919063.825825:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550319744 00000100:00100000:0.0:1790919063.825829:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550319744 00000100:00100000:0.0:1790919063.825850:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550319872 00000100:00100000:0.0:1790919063.825852:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550319872 00000100:00100000:0.0:1790919063.825870:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1790919063.825876:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877914550319744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919063.825907:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877914550319744:12345-0@lo:400:kworker.0 Request processed in 31us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919063.825913:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1790919063.825924:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1790919063.825930:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877914550319872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919063.825956:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877914550319872:12345-0@lo:400:kworker.0 Request processed in 26us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919063.825961:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1790919063.825975:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790919063.825978:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790919063.825980:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790919063.826008:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88beb3b64000 x1877914550320000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919063.826028:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550320000:0@lo:400:kworker.0 00000100:00100000:0.0:1790919063.826681:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1877914550319872:0@lo:400:kworker.0 00000100:00100000:0.0:1790919063.826697:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877914550319744:0@lo:400:kworker.0 00010000:00080000:0.0:1790919063.826706:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88beb3b66300 x1877914550320256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919063.826714:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550320256:0@lo:400:kworker.0 00000100:00100000:0.0:1790919064.322447:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf788700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550320384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790919064.322522:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919064.322707:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550320384 00000100:00100000:1.0:1790919064.322717:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550320384 00000100:00100000:1.0:1790919064.322775:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790919064.322786:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550320384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790919064.322822:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919064.322880:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550320384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919064.322887:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1790919064.322969:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebf788700 x1877914550320384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919080 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919064.322989:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf788700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550320384:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790919064.833077:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1790919065.447077:0:7662:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5591729f-44f1-43f1-b042-c3a508737d97 00000020:00000080:2.0:1790919065.447085:0:7662:0:(genops.c:885:class_export_put()) final put ffff88be87131000/5591729f-44f1-43f1-b042-c3a508737d97 00000020:00000080:3.0:1790919065.449615:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88be87131000/5591729f-44f1-43f1-b042-c3a508737d97 for lustre-OST0001 00000020:00000080:3.0:1790919065.449679:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88be87135800 for lustre-OST0001 00010000:00010000:2.0:1790919065.855917:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790919065.940773:0:6722:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5591729f-44f1-43f1-b042-c3a508737d97 00000020:00000080:1.0:1790919065.940785:0:6722:0:(genops.c:885:class_export_put()) final put ffff88be87135000/5591729f-44f1-43f1-b042-c3a508737d97 00000020:00000080:1.0:1790919065.940814:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88be87135000/5591729f-44f1-43f1-b042-c3a508737d97 for lustre-OST0000 00000020:00000080:1.0:1790919065.940867:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88be87136800 for lustre-OST0000 00000100:00100000:1.0:1790919066.367858:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf789180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550320512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790919066.367948:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919066.368063:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550320512 00000100:00100000:1.0:1790919066.368072:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550320512 00000100:00100000:1.0:1790919066.368162:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790919066.368173:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf78a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550320512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790919066.368219:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919066.368308:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf78a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550320512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919066.368315:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1790919066.368339:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790919066.368371:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebf789180 x1877914550320512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919082 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919066.368403:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf789180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550320512:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1790919066.786822:0:11040:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1790919066.880656:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919067.355107:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919067.355218:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919067.355266:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919067.355323:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532460672 00000100:00100000:2.0:1790919067.355333:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532460672 00000100:00100000:2.0:1790919067.355403:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 228 00000100:00100000:2.0:1790919067.355413:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87167450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+13:2353:x1877914532460672:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:2.0:1790919067.355498:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87167450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+13:2353:x1877914532460672:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 86us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919067.355506:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 228 00000100:00100000:0.0:1790919067.369025:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532460800 00000100:00100000:0.0:1790919067.369044:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532460800 00000100:00100000:0.0:1790919067.369177:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532460928 00000100:00100000:0.0:1790919067.369182:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532460928 00000100:00100000:0.0:1790919067.369215:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 84 00000100:00100000:0.0:1790919067.369227:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2353:x1877914532460800:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:0.0:1790919067.369322:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2353:x1877914532460800:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 98us (14226us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919067.369330:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 84 00000100:00100000:0.0:1790919067.369349:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 85 00000100:00100000:0.0:1790919067.369355:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5591729f-44f1-43f1-b042-c3a508737d97+5:2353:x1877914532460928:12345-192.168.201.27@tcp:400:kworker.0 00000100:00080000:2.0:1790919067.369512:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790919067.376158:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5591729f-44f1-43f1-b042-c3a508737d97+5:2353:x1877914532460928:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 6791us (20880us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919067.376174:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 85 00010000:00010000:3.0:1790919067.904142:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919068.927720:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790919068.927762:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550321024:0@lo:400:kworker.0 00000100:00100000:3.0:1790919068.927763:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1877914550321152:0@lo:400:kworker.0 00010000:00010000:1.0:1790919068.927865:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919068.934140:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877914550320768:0@lo:400:kworker.0 00000100:00100000:3.0:1790919068.935481:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919068.935573:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919068.935583:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550321152 00000100:00100000:3.0:1790919068.935595:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550321152 00000100:00100000:0.0:1790919068.935650:0:10350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550321024 00000100:00100000:0.0:1790919068.935657:0:10350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550321024 00000100:00100000:3.0:1790919068.935675:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1790919068.935688:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877914550321152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919068.935703:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790919068.935713:0:10350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550321024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919068.935768:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877914550321152:12345-0@lo:400:kworker.0 Request processed in 83us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919068.935773:0:10350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550321024:12345-0@lo:400:kworker.0 Request processed in 60us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919068.935780:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790919068.935786:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790919068.935816:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1877914550320896:0@lo:400:kworker.0 00000100:00100000:3.0:1790919068.935858:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1790919068.935871:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88beb3b65880 x1877914550321024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919068.935889:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550321024:0@lo:400:kworker.0 00000100:00080000:3.0:1790919068.935894:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790919068.935901:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790919068.935902:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550320640:0@lo:400:kworker.0 00000100:00100000:3.0:1790919068.935910:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550320896 00000100:00100000:3.0:1790919068.935915:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550320896 00000100:00100000:0.0:1790919068.935944:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919068.935946:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1790919068.935955:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877914550320896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919068.935978:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550320640 00000100:00100000:0.0:1790919068.935983:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550320640 00000100:00100000:3.0:1790919068.935996:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877914550320896:12345-0@lo:400:kworker.0 Request processed in 41us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919068.936017:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1790919068.936025:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790919068.936030:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3305:x1877914550320640:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1790919068.936048:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790919068.936076:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1877914550320896:0@lo:400:kworker.0 00000100:00100000:0.0:1790919068.936082:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3305:x1877914550320640:12345-0@lo:400:kworker.0 Request processed in 55us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919068.936091:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1790919068.936120:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1877914550321152:0@lo:400:kworker.0 00000100:00100000:0.0:1790919068.936148:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550320640:0@lo:400:kworker.0 00000100:00100000:1.0:1790919068.950748:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919068.950817:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550321280:0@lo:400:kworker.0 00000100:00100000:1.0:1790919068.950860:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919068.950945:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550320768 00000100:00100000:2.0:1790919068.950958:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550320768 00000100:00100000:2.0:1790919068.951039:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1790919068.951051:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf789180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877914550320768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919068.951124:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf789180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877914550320768:12345-0@lo:400:kworker.0 Request processed in 75us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919068.951131:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790919068.951519:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550321280 00000100:00100000:0.0:1790919068.951565:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550321280 00000100:00100000:0.0:1790919068.951617:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790919068.951624:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf78b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550321280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919068.951689:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf78b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550321280:12345-0@lo:400:kworker.0 Request processed in 66us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919068.951696:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1790919068.951797:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790919068.954603:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877914550320768:0@lo:400:kworker.0 00010000:00080000:1.0:1790919068.954630:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88beb3b64a80 x1877914550321280/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919068.954642:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550321280:0@lo:400:kworker.0 00000100:00100000:0.0:1790919069.440765:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790919069.440799:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf78bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550321408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790919069.440900:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919069.441087:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550321408 00000100:00100000:1.0:1790919069.441098:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550321408 00000100:00100000:1.0:1790919069.441167:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790919069.441179:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550321408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790919069.441236:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919069.441301:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550321408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919069.441308:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1790919069.441399:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebf78bb80 x1877914550321408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919085 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919069.441422:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf78bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550321408:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790919069.951842:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919070.975876:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919071.487868:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf788380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550321536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790919071.487977:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919071.488203:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550321536 00000100:00100000:1.0:1790919071.488215:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550321536 00000100:00100000:1.0:1790919071.488298:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790919071.488310:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebfbf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550321536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790919071.488372:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919071.488432:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebfbf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550321536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919071.488440:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1790919071.488493:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebf788380 x1877914550321536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919087 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919071.488515:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf788380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550321536:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790919071.488675:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790919072.000213:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790919072.194942:0:11188:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe0214e370 20000000:00000080:1.0:1790919072.194966:0:11188:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff88bebacb6c00 uarg=0000000000000000 20000000:01000000:1.0:1790919072.195016:0:11188:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1790919072.195023:0:11188:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1790919072.195029:0:11188:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1790919072.196278:0:11189:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1790919072.196490:0:11188:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1790919072.206552:0:11188:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1790919072.206957:0:11188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88be88386000/0xc3296956897c431d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919072.206982:0:11188:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88be81672400/0xc3296956897c42c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c42c2 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919072.206990:0:11188:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88be81673600/0xc3296956897c42d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c42d0 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919072.206997:0:11188:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88be81673800/0xc3296956897c42e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c42de expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919072.207008:0:11188:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88be81672c00/0xc3296956897c42ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb09 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919072.207015:0:11188:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88be81516600/0xc3296956897c4301 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb41 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919072.207023:0:11188:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88be88386000/0xc3296956897c431d lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919072.207081:0:11188:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88be81516600/0xc3296956897c4301 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb41 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919072.207099:0:11188:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88be81516600/0xc3296956897c4301 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb41 expref: 12 pid: 5838 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919072.207118:0:11188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebfbf1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11188:1877914550321664:192.168.201.27@tcp:104: 00010000:00010000:2.0:1790919072.207333:0:11188:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88be81672c00/0xc3296956897c42ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb09 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919072.207343:0:11188:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88be81672c00/0xc3296956897c42ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb09 expref: 12 pid: 5839 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919072.207352:0:11188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebfbf3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11188:1877914550321792:192.168.201.27@tcp:104: 00010000:00010000:2.0:1790919072.207387:0:11188:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88be81673800/0xc3296956897c42e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3296956897c42de expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919072.207396:0:11188:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88be81673800/0xc3296956897c42e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3296956897c42de expref: 18 pid: 5839 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919072.207406:0:11188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebfbf1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11188:1877914550321920:0@lo:104: 00000100:00100000:2.0:1790919072.207458:0:11188:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790919072.207511:0:11188:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88be81673600/0xc3296956897c42d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3296956897c42d0 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919072.207521:0:11188:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88be81673600/0xc3296956897c42d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3296956897c42d0 expref: 18 pid: 5839 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919072.207564:0:11188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebfbf2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11188:1877914550322048:0@lo:104: 00000100:00100000:2.0:1790919072.207587:0:11188:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790919072.207622:0:11188:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88be81672400/0xc3296956897c42c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3296956897c42c2 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919072.207631:0:11188:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88be81672400/0xc3296956897c42c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3296956897c42c2 expref: 18 pid: 5838 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919072.207640:0:11188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebfbf0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11188:1877914550322176:0@lo:104: 00000100:00100000:2.0:1790919072.207670:0:11188:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919072.207681:0:11188:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beba888480 going to sleep for 11 seconds 00000100:00100000:1.0:1790919072.207920:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550321920 00000100:00100000:1.0:1790919072.207930:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550321920 00000100:00100000:1.0:1790919072.208011:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550322048 00000100:00100000:1.0:1790919072.208015:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550322048 00000100:00100000:1.0:1790919072.208026:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550322176 00000100:00100000:1.0:1790919072.208029:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550322176 00000100:00100000:1.0:1790919072.208043:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790919072.208052:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebfbf3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+5:11188:x1877914550321920:12345-0@lo:104: 00010000:00010000:1.0:1790919072.208074:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.127@tcp lock: ffff88be81672e00/0xc3296956897c42de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c42e5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919072.208144:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790919072.208150:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebfbf3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+5:11188:x1877914550321920:12345-0@lo:104: Request processed in 99us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919072.208158:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790919072.208192:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790919072.208199:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebfbf0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+4:11188:x1877914550322048:12345-0@lo:104: 00010000:00010000:1.0:1790919072.208207:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.127@tcp lock: ffff88be88386a00/0xc3296956897c42d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c42d7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919072.208245:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790919072.208249:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebfbf0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+4:11188:x1877914550322048:12345-0@lo:104: Request processed in 52us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919072.208255:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790919072.208268:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790919072.208274:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebacb3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+3:11188:x1877914550322176:12345-0@lo:104: 00010000:00010000:1.0:1790919072.208282:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.127@tcp lock: ffff88bd81147a00/0xc3296956897c42c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c42c9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919072.208316:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1790919072.208321:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebacb3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+3:11188:x1877914550322176:12345-0@lo:104: Request processed in 49us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919072.208327:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1790919072.208350:0:7650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790919072.208357:0:7650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff88be81672e00/0xc3296956897c42de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c42e5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919072.208371:0:7650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81672e00 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:1.0:1790919072.208376:0:7650:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff88be81672e00/0xc3296956897c42de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3296956897c42e5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919072.208384:0:7650:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff88be81672e00/0xc3296956897c42de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3296956897c42e5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790919072.208392:0:7650:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff88be81672e00/0xc3296956897c42de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3296956897c42e5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919072.208398:0:7650:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790919072.208434:0:7650:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff88be81672e00/0xc3296956897c42de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c42e5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919072.208441:0:7650:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790919072.208465:0:7650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff88be81672e00/0xc3296956897c42de lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c42e5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919072.208471:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff88be81672e00/0xc3296956897c42de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c42e5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919072.208484:0:7650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790919072.208487:0:7650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff88be88386a00/0xc3296956897c42d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c42d7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919072.208494:0:7650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386a00 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:1.0:1790919072.208497:0:7650:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff88be88386a00/0xc3296956897c42d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3296956897c42d7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919072.208513:0:7650:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff88be88386a00/0xc3296956897c42d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3296956897c42d7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790919072.208520:0:7650:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff88be88386a00/0xc3296956897c42d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3296956897c42d7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919072.208562:0:7650:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790919072.208578:0:7650:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff88be88386a00/0xc3296956897c42d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c42d7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919072.208584:0:7650:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790919072.208601:0:7650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff88be88386a00/0xc3296956897c42d0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c42d7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919072.208608:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff88be88386a00/0xc3296956897c42d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c42d7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919072.208617:0:7650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919072.208620:0:7650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff88bd81147a00/0xc3296956897c42c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c42c9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919072.208625:0:7650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bd81147a00 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:1.0:1790919072.208628:0:7650:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff88bd81147a00/0xc3296956897c42c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3296956897c42c9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919072.208634:0:7650:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff88bd81147a00/0xc3296956897c42c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3296956897c42c9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790919072.208640:0:7650:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff88bd81147a00/0xc3296956897c42c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3296956897c42c9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919072.208652:0:7650:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790919072.208666:0:7650:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff88bd81147a00/0xc3296956897c42c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c42c9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919072.208672:0:7650:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790919072.208678:0:7650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff88bd81147a00/0xc3296956897c42c2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c42c9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919072.208685:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff88bd81147a00/0xc3296956897c42c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c42c9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919072.208700:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919072.208702:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919072.208703:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919072.208728:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf788380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3306:1877914550322304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790919072.208768:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919072.208815:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf78aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3307:1877914550322432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790919072.208839:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919072.208858:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790919072.208864:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf789c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3307:1877914550322560:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790919072.208885:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919072.208913:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550322304 00000100:00100000:1.0:1790919072.208917:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550322304 00010000:00010000:1.0:1790919072.208939:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88be81673800/0xc3296956897c42e5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c42de expref: 19 pid: 5839 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919072.208961:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550322432 00000100:00100000:1.0:1790919072.208964:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550322432 00010000:00010000:1.0:1790919072.208984:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88be81673600/0xc3296956897c42d7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c42d0 expref: 20 pid: 5839 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919072.208996:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550322560 00000100:00100000:1.0:1790919072.208998:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550322560 00010000:00010000:1.0:1790919072.209008:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88be81672400/0xc3296956897c42c9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c42c2 expref: 21 pid: 5838 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919072.209019:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790919072.209026:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be91cad450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+21:3306:x1877914550322304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790919072.209038:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919072.209044:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88be81673800/0xc3296956897c42e5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c42de expref: 21 pid: 5839 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919072.209053:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88be81673800/0xc3296956897c42e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3296956897c42de expref: 21 pid: 5839 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919072.209071:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919072.209101:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be91cad450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+21:3306:x1877914550322304:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919072.209108:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790919072.209155:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790919072.209175:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf78bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+20:3307:x1877914550322432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790919072.209183:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919072.209187:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88be81673600/0xc3296956897c42d7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c42d0 expref: 20 pid: 5839 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919072.209195:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88be81673600/0xc3296956897c42d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3296956897c42d0 expref: 20 pid: 5839 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919072.209215:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919072.209241:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf78bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+20:3307:x1877914550322432:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919072.209249:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790919072.209261:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790919072.209267:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf788700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3307:x1877914550322560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790919072.209274:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919072.209278:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88be81672400/0xc3296956897c42c9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c42c2 expref: 19 pid: 5838 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919072.209286:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88be81672400/0xc3296956897c42c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3296956897c42c2 expref: 19 pid: 5838 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919072.209296:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919072.209317:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf788700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3307:x1877914550322560:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919072.209323:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790919072.209365:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf788380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3306:1877914550322304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790919072.209390:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf789c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3307:1877914550322560:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790919072.209397:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf78aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3307:1877914550322432:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790919072.209688:0:11188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be81673800/0xc3296956897c42e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3296956897c42de expref: 18 pid: 5839 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919072.209704:0:11188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebfbf1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11188:1877914550321920:0@lo:104: 00010000:00010000:2.0:1790919072.209713:0:11188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be81673600/0xc3296956897c42d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3296956897c42d0 expref: 17 pid: 5839 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919072.209721:0:11188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebfbf2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11188:1877914550322048:0@lo:104: 00010000:00010000:2.0:1790919072.209729:0:11188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be81672400/0xc3296956897c42c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3296956897c42c2 expref: 16 pid: 5838 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919072.209737:0:11188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebfbf0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11188:1877914550322176:0@lo:104: 00010000:00010000:3.0:1790919072.209978:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919072.209988:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919072.213498:0:11188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebfbf1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11188:1877914550321664:192.168.201.27@tcp:104: 00000100:00100000:1.0:1790919072.213519:0:11188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebfbf3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11188:1877914550321792:192.168.201.27@tcp:104: 00010000:00010000:1.0:1790919072.213599:0:11188:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88be88386000/0xc3296956897c431d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919072.219396:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919072.219602:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919072.219802:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532461184 00000100:00100000:0.0:1790919072.219815:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532461184 00010000:00010000:0.0:1790919072.219867:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88be81672c00/0xc3296956897c42ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb09 expref: 13 pid: 5839 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919072.219918:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532461056 00000100:00100000:0.0:1790919072.219922:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532461056 00010000:00010000:0.0:1790919072.219938:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88be81516600/0xc3296956897c4301 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb41 expref: 14 pid: 5838 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919072.219962:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 28 00000100:00100000:0.0:1790919072.219973:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf78aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:002ffd4e-702a-440d-a423-3e840d72bb2e+14:2352:x1877914532461184:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790919072.219993:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919072.220000:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88be81672c00/0xc3296956897c42ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb09 expref: 14 pid: 5839 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919072.220013:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88be81672c00/0xc3296956897c42ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb09 expref: 14 pid: 5839 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919072.220064:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be81672c00/0xc3296956897c42ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb09 expref: 14 pid: 5839 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919072.220087:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919072.220173:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf78aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:002ffd4e-702a-440d-a423-3e840d72bb2e+13:2352:x1877914532461184:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 189us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919072.220182:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 28 00000100:00100000:0.0:1790919072.220203:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 29 00000100:00100000:0.0:1790919072.220210:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf789c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:002ffd4e-702a-440d-a423-3e840d72bb2e+12:2352:x1877914532461056:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790919072.220219:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919072.220223:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88be81516600/0xc3296956897c4301 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb41 expref: 12 pid: 5838 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919072.220234:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88be81516600/0xc3296956897c4301 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb41 expref: 12 pid: 5838 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919072.220246:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be81516600/0xc3296956897c4301 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb41 expref: 12 pid: 5838 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919072.220260:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88be88386000/0xc3296956897c431d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919072.220271:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be88386000/0xc3296956897c431d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919072.220289:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88be88386000/0xc3296956897c431d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919072.220308:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88be88386000/0xc3296956897c431d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919072.220317:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88be88386000/0xc3296956897c431d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919072.220326:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88be88386000/0xc3296956897c431d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919072.220333:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386000 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:0.0:1790919072.220340:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88be88386000/0xc3296956897c431d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919072.220349:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88be88386000/0xc3296956897c431d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919072.220365:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88be88386000/0xc3296956897c431d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919072.220377:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919072.220398:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf789c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:002ffd4e-702a-440d-a423-3e840d72bb2e+11:2352:x1877914532461056:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 188us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919072.220405:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 29 00010000:00010000:1.0:1790919072.221834:0:11188:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88be88386000/0xc3296956897c431d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919072.221853:0:11188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88be88386000/0xc3296956897c431d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919072.221861:0:11188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be88386000/0xc3296956897c431d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919072.484064:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919072.484118:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919072.484151:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532461312 00000100:00100000:1.0:1790919072.484177:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532461312 00000100:00100000:2.0:1790919072.484237:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919072.484259:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 230 00000100:00100000:1.0:1790919072.484272:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87165c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+11:2353:x1877914532461312:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:1.0:1790919072.484364:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87165c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+11:2353:x1877914532461312:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 94us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919072.484374:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 230 00000100:00100000:0.0:1790919072.499397:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532461568 00000100:00100000:0.0:1790919072.499421:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532461568 00000100:00100000:1.0:1790919072.499660:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532461440 00000100:00100000:1.0:1790919072.499677:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532461440 00000100:00100000:1.0:1790919072.499714:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 89 00000100:00100000:1.0:1790919072.499723:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebacb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5591729f-44f1-43f1-b042-c3a508737d97+5:2353:x1877914532461568:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:1.0:1790919072.499809:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebacb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5591729f-44f1-43f1-b042-c3a508737d97+5:2353:x1877914532461568:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 86us (15690us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919072.499817:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 89 00000100:00100000:1.0:1790919072.499836:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 90 00000100:00100000:1.0:1790919072.499860:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebacb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2353:x1877914532461440:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:1.0:1790919072.499897:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebacb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2353:x1877914532461440:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 40us (15662us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919072.499904:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 90 00000100:00080000:1.0:1790919072.499923:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790919073.023827:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790919073.409804:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790919073.409815:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88bebf8da800 from 7 10000000:01000000:0.0:1790919073.409823:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790919073.410825:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88bd81146000/0xc3296956897c4324 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919073.410870:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88bd81146000/0xc3296956897c4324 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919073.411315:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88bd81146000/0xc3296956897c4324 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919073.411359:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b3b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550322688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790919073.411457:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919073.411556:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be86bfb240 going to sleep for 11 seconds 00000100:00100000:1.0:1790919073.412471:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550322688 00000100:00100000:1.0:1790919073.412483:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550322688 00000100:00100000:1.0:1790919073.412552:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1790919073.412560:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+16:5842:x1877914550322688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790919073.412575:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919073.412671:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88beb3f7fc00/0xc3296956897c432b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c4324 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919073.412696:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88beb3f7fc00/0xc3296956897c432b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c4324 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919073.412705:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88beb3f7fc00/0xc3296956897c432b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c4324 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919073.412711:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88beb3f7fc00, rc 0) 00000100:00100000:1.0:1790919073.412768:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:5842:x1877914550322688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 210us (1313us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919073.412773:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1790919073.413245:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b3b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550322688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790919073.413278:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88bd81146000/0xc3296956897c4324 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c432b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919073.413291:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88bd81146000/0xc3296956897c4324 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c432b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919073.413393:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b3b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550322816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790919073.413448:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919073.413502:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be86bfb240 going to sleep for 11 seconds 00000100:00100000:1.0:1790919073.413806:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550322816 00000100:00100000:1.0:1790919073.413815:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550322816 00000100:00100000:1.0:1790919073.413922:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1790919073.413932:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87166c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:5842:x1877914550322816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790919073.414326:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87166c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:5842:x1877914550322816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 394us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919073.414334:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1790919073.414424:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b3b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550322816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790919073.414466:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b3b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550322944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790919073.414511:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919073.421498:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be86bfb240 going to sleep for 11 seconds 00000100:00100000:3.0:1790919073.426183:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550322944 00000100:00100000:3.0:1790919073.426204:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550322944 00000100:00100000:3.0:1790919073.426278:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1790919073.426289:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:5842:x1877914550322944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790919073.427436:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:5842:x1877914550322944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1140us (12915us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919073.427454:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1790919073.431670:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b3b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550322944:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790919073.434255:0:11209:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1790919073.435823:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1790919073.435865:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790919073.435880:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88bd81146000/0xc3296956897c4324 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c432b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919073.435906:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88bd81146000/0xc3296956897c4324 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c432b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919073.435918:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790919073.435922:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88be86b70000 from 7 10000000:01000000:1.0:1790919073.435925:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790919073.436019:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88beb3f7f600/0xc3296956897c4332 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919073.436279:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88beb3f7f600/0xc3296956897c4332 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919073.436295:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88beb3f7f600/0xc3296956897c4332 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919073.436332:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf788380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550323072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790919073.436428:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919073.436489:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be8e285b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790919073.436562:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550323072 00000100:00100000:2.0:1790919073.436576:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550323072 00000100:00100000:2.0:1790919073.436660:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1790919073.436674:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:5842:x1877914550323072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790919073.436692:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919073.436710:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be88386a00/0xc3296956897c4339 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c4332 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919073.436736:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be88386a00/0xc3296956897c4339 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c4332 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919073.436747:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be88386a00/0xc3296956897c4339 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c4332 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919073.436770:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be88386a00, rc 0) 00000100:00100000:2.0:1790919073.436845:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:5842:x1877914550323072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919073.436852:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1790919073.437000:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf788380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550323072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790919073.437790:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88beb3f7f600/0xc3296956897c4332 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c4339 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919073.437817:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88beb3f7f600/0xc3296956897c4332 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c4339 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919073.437975:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf788380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550323200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790919073.438264:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919073.438311:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be8e285b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790919073.441070:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550323200 00000100:00100000:2.0:1790919073.441086:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550323200 00000100:00100000:2.0:1790919073.441167:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1790919073.441177:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:5842:x1877914550323200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790919073.441494:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:5842:x1877914550323200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 317us (3230us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919073.441501:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1790919073.441607:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf788380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550323200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790919073.441756:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b66d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550323328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790919073.441837:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919073.441956:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb44eb540 going to sleep for 11 seconds 00000100:00100000:1.0:1790919073.441999:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550323328 00000100:00100000:1.0:1790919073.442011:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550323328 00000100:00100000:1.0:1790919073.442047:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1790919073.442054:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:5842:x1877914550323328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790919073.442246:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:5842:x1877914550323328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 192us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919073.442253:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1790919073.442306:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b66d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550323328:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790919073.444978:0:11210:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1790919073.445374:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1790919073.445408:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790919073.445424:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88beb3f7f600/0xc3296956897c4332 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c4339 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919073.445450:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88beb3f7f600/0xc3296956897c4332 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c4339 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919073.445464:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790919073.445467:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88be91614800 from 7 10000000:01000000:3.0:1790919073.445471:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790919073.445519:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be81516800/0xc3296956897c4340 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919073.445567:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88be81516800/0xc3296956897c4340 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919073.445579:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88be81516800/0xc3296956897c4340 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919073.445609:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b66d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550323456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790919073.445771:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919073.445822:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb44eb540 going to sleep for 11 seconds 00000100:00100000:2.0:1790919073.445960:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550323456 00000100:00100000:2.0:1790919073.445970:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550323456 00000100:00100000:2.0:1790919073.446038:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1790919073.446049:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:5842:x1877914550323456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790919073.446066:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919073.446081:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be88386200/0xc3296956897c4347 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c4340 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919073.446109:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be88386200/0xc3296956897c4347 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c4340 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919073.446120:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be88386200/0xc3296956897c4347 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c4340 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919073.446129:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be88386200, rc 0) 00000100:00100000:2.0:1790919073.446202:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:5842:x1877914550323456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919073.446209:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1790919073.446262:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b66d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550323456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790919073.446278:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88be81516800/0xc3296956897c4340 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c4347 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919073.446288:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88be81516800/0xc3296956897c4340 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c4347 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919073.446351:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebacb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550323584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790919073.446377:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919073.446388:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beba8886c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790919073.446830:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550323584 00000100:00100000:3.0:1790919073.446839:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550323584 00000100:00100000:3.0:1790919073.446871:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1790919073.446878:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87166050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:5842:x1877914550323584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790919073.447462:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87166050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:5842:x1877914550323584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 578us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919073.447472:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1790919073.448266:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebacb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550323584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790919073.448337:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebacb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550323712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790919073.448407:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919073.448462:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beba8886c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919073.448480:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550323712 00000100:00100000:0.0:1790919073.448510:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550323712 00000100:00100000:0.0:1790919073.448587:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1790919073.448596:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87164c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:5842:x1877914550323712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790919073.448819:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87164c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:5842:x1877914550323712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 224us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919073.448827:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1790919073.449013:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebacb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550323712:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790919073.450356:0:11212:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1790919073.450743:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1790919073.450777:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790919073.450792:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be81516800/0xc3296956897c4340 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c4347 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919073.450806:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88be81516800/0xc3296956897c4340 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c4347 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919073.549378:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919073.549612:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532461696 00000100:00100000:2.0:1790919073.549626:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532461696 00000100:00100000:2.0:1790919073.549747:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 240 00000100:00100000:2.0:1790919073.549757:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87165050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+11:5591:x1877914532461696:12345-192.168.201.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790919073.549785:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919073.549807:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be88387c00/0xc3296956897c434e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8b413717672cb6b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919073.549838:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be88387c00/0xc3296956897c434e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb6b expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919073.549848:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be88387c00/0xc3296956897c434e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb6b expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919073.549856:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be88387c00, rc 0) 00000100:00100000:2.0:1790919073.549928:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87165050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+12:5591:x1877914532461696:12345-192.168.201.27@tcp:101:ll_cfg_requeue.0 Request processed in 172us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919073.549935:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 240 00000100:00100000:3.0:1790919073.555838:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919073.556049:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532461824 00000100:00100000:0.0:1790919073.556063:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532461824 00000100:00100000:0.0:1790919073.556126:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 241 00000100:00100000:0.0:1790919073.556147:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+12:5591:x1877914532461824:12345-192.168.201.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790919073.556559:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+12:5591:x1877914532461824:12345-192.168.201.27@tcp:501:ll_cfg_requeue.0 Request processed in 424us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919073.556570:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 241 00000100:00100000:3.0:1790919073.566879:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919073.567129:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532461952 00000100:00100000:0.0:1790919073.567153:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532461952 00000100:00100000:0.0:1790919073.567224:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 242 00000100:00100000:0.0:1790919073.567236:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87164450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+12:5591:x1877914532461952:12345-192.168.201.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790919073.567548:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87164450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+12:5591:x1877914532461952:12345-192.168.201.27@tcp:503:ll_cfg_requeue.0 Request processed in 291us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919073.567558:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 242 00000100:00100000:3.0:1790919073.597445:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919073.597912:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532462080 00000100:00100000:1.0:1790919073.597928:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532462080 00000100:00100000:1.0:1790919073.597990:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 243 00000100:00100000:1.0:1790919073.598001:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87167c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+12:5591:x1877914532462080:12345-192.168.201.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790919073.598024:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919073.598048:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88beb3f7ee00/0xc3296956897c4355 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8b413717672cb72 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919073.598088:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88beb3f7ee00/0xc3296956897c4355 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb72 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919073.598121:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88beb3f7ee00/0xc3296956897c4355 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb72 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919073.598132:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88beb3f7ee00, rc 0) 00000100:00100000:1.0:1790919073.598215:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87167c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+13:5591:x1877914532462080:12345-192.168.201.27@tcp:101:ll_cfg_requeue.0 Request processed in 216us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919073.598222:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 243 00000100:00100000:0.0:1790919073.605673:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919073.605769:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532462208 00000100:00100000:3.0:1790919073.605782:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532462208 00000100:00100000:3.0:1790919073.605850:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 244 00000100:00100000:3.0:1790919073.605862:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be86bb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+13:5591:x1877914532462208:12345-192.168.201.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790919073.606283:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be86bb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+13:5591:x1877914532462208:12345-192.168.201.27@tcp:501:ll_cfg_requeue.0 Request processed in 421us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919073.606292:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 244 00000100:00100000:1.0:1790919073.623773:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919073.623857:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532462336 00000100:00100000:0.0:1790919073.623872:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532462336 00000100:00100000:0.0:1790919073.623956:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 245 00000100:00100000:0.0:1790919073.623969:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be86bbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+13:5591:x1877914532462336:12345-192.168.201.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790919073.624448:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be86bbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+13:5591:x1877914532462336:12345-192.168.201.27@tcp:503:ll_cfg_requeue.0 Request processed in 480us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919073.624467:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 245 00000100:00100000:3.0:1790919074.047807:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1877914550324224:0@lo:400:kworker.0 00000100:00100000:3.0:1790919074.047914:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919074.047994:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790919074.048001:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550324096:0@lo:400:kworker.0 00000100:00100000:3.0:1790919074.048028:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919074.048072:0:10350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550324096 00000100:00100000:3.0:1790919074.048081:0:10350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550324096 00000100:00100000:3.0:1790919074.048155:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790919074.048166:0:10350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550324096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919074.048223:0:10350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550324096:12345-0@lo:400:kworker.0 Request processed in 60us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919074.048231:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1790919074.048279:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88beb3b67800 x1877914550324096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919074.048295:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550324096:0@lo:400:kworker.0 00010000:00010000:3.0:1790919074.049901:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919074.050020:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877914550323840:0@lo:400:kworker.0 00000100:00100000:1.0:1790919074.050096:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919074.050146:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550324352:0@lo:400:kworker.0 00000100:00100000:1.0:1790919074.050173:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919074.050216:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790919074.050224:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1877914550323968:0@lo:400:kworker.0 00000100:00100000:1.0:1790919074.050246:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919074.050288:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550324224 00000100:00100000:1.0:1790919074.050297:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550324224 00000100:00100000:1.0:1790919074.050350:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550323840 00000100:00100000:1.0:1790919074.050354:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550323840 00000100:00100000:1.0:1790919074.050367:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550323968 00000100:00100000:1.0:1790919074.050370:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550323968 00000100:00100000:1.0:1790919074.050388:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1790919074.050397:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877914550324224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919074.050459:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877914550324224:12345-0@lo:400:kworker.0 Request processed in 61us (2544us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919074.050466:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1790919074.050500:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1790919074.050506:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf78a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877914550323840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919074.050569:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf78a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877914550323840:12345-0@lo:400:kworker.0 Request processed in 62us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919074.050576:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1790919074.050588:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790919074.050594:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf78b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877914550323968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919074.050622:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf78b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877914550323968:12345-0@lo:400:kworker.0 Request processed in 28us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919074.050628:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:1.0:1790919074.050646:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790919074.050651:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790919074.050702:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1877914550323968:0@lo:400:kworker.0 00000100:00100000:1.0:1790919074.050716:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877914550323840:0@lo:400:kworker.0 00000100:00100000:1.0:1790919074.050749:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1877914550324224:0@lo:400:kworker.0 00000100:00100000:3.0:1790919074.051265:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550324352 00000100:00100000:3.0:1790919074.051272:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550324352 00000100:00100000:3.0:1790919074.051342:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790919074.051350:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf789500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550324352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919074.051404:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf789500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550324352:12345-0@lo:400:kworker.0 Request processed in 56us (1230us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919074.051411:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1790919074.051782:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1790919074.052031:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88beb3b64700 x1877914550324352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919074.052046:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550324352:0@lo:400:kworker.0 00000100:00100000:2.0:1790919074.563902:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550324480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790919074.563982:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919074.564111:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550324480 00000100:00100000:3.0:1790919074.564130:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550324480 00000100:00100000:3.0:1790919074.564182:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790919074.564191:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebacb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550324480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790919074.564227:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919074.564970:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebacb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550324480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 777us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919074.564979:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1790919074.572575:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88beb3b3b100 x1877914550324480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919090 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919074.572603:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550324480:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790919075.071898:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919076.096714:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919076.607711:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790919076.607735:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf788a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550324608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790919076.607819:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919076.612262:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550324608 00000100:00100000:1.0:1790919076.612276:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550324608 00000100:00100000:1.0:1790919076.612746:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790919076.612757:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550324608:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790919076.612786:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1790919076.612797:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919076.612883:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550324608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (5064us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919076.612915:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1790919076.612926:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebf788a80 x1877914550324608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919092 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919076.612945:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf788a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550324608:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1790919077.017450:0:11387:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg127-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1790919077.119923:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919077.591167:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919077.591230:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919077.591281:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532462592 00000100:00100000:2.0:1790919077.591291:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532462592 00000100:00100000:2.0:1790919077.591360:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 94 00000100:00100000:2.0:1790919077.591373:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2350:x1877914532462592:12345-192.168.201.27@tcp:400:kworker.0 00000100:00080000:1.0:1790919077.591438:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790919077.591470:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2350:x1877914532462592:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 101us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919077.591480:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 94 00000100:00100000:1.0:1790919077.593989:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919077.594221:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532462720 00000100:00100000:2.0:1790919077.594230:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532462720 00000100:00080000:1.0:1790919077.594402:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790919077.595858:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 95 00000100:00100000:2.0:1790919077.595878:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf788e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5591729f-44f1-43f1-b042-c3a508737d97+5:2350:x1877914532462720:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:2.0:1790919077.595985:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf788e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5591729f-44f1-43f1-b042-c3a508737d97+5:2350:x1877914532462720:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 115us (2003us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919077.595993:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 95 00000100:00100000:3.0:1790919077.600147:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532462464 00000100:00100000:3.0:1790919077.600164:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532462464 00000100:00100000:3.0:1790919077.600418:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 246 00000100:00100000:3.0:1790919077.600428:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be86bb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+13:2350:x1877914532462464:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1790919077.600517:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be86bb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+13:2350:x1877914532462464:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 90us (9286us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919077.600548:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 246 00010000:00010000:2.0:1790919078.144493:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919079.168920:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919079.169885:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790919079.170011:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877914550324864:0@lo:400:kworker.0 00000100:00100000:3.0:1790919079.170089:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919079.170141:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790919079.170157:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1877914550324992:0@lo:400:kworker.0 00000100:00100000:3.0:1790919079.170181:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919079.170214:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550324864 00000100:00100000:3.0:1790919079.170222:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550324864 00000100:00100000:3.0:1790919079.170263:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550324992 00000100:00100000:3.0:1790919079.170267:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550324992 00000100:00100000:3.0:1790919079.170295:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1790919079.170303:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877914550324864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919079.170355:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877914550324864:12345-0@lo:400:kworker.0 Request processed in 52us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919079.170362:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1790919079.170379:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1790919079.170385:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877914550324992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919079.170411:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877914550324992:12345-0@lo:400:kworker.0 Request processed in 27us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919079.170417:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1790919079.170460:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1877914550324992:0@lo:400:kworker.0 00000100:00100000:3.0:1790919079.170470:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877914550324864:0@lo:400:kworker.0 00000100:00100000:1.0:1790919079.173686:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550325120:0@lo:400:kworker.0 00000100:00100000:1.0:1790919079.173766:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919079.173813:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3307:1877914550324736:0@lo:400:kworker.0 00000100:00100000:1.0:1790919079.173842:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790919079.173885:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790919079.173901:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550324736 00000100:00100000:1.0:1790919079.173908:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550324736 00000100:00100000:1.0:1790919079.173952:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1790919079.173959:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be86bba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3307:x1877914550324736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919079.174006:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be86bba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3307:x1877914550324736:12345-0@lo:400:kworker.0 Request processed in 47us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919079.174013:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1790919079.174073:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3307:1877914550324736:0@lo:400:kworker.0 00000100:00100000:3.0:1790919079.174215:0:10350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550325120 00000100:00100000:3.0:1790919079.174220:0:10350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550325120 00000100:00100000:3.0:1790919079.174268:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790919079.174277:0:10350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf789880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550325120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919079.174316:0:10350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf789880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550325120:12345-0@lo:400:kworker.0 Request processed in 42us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919079.174323:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1790919079.175800:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790919079.175837:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88beb3b38e00 x1877914550325120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919079.175851:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550325120:0@lo:400:kworker.0 00000100:00100000:0.0:1790919079.176615:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790919079.176628:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550325376:0@lo:400:kworker.0 00000100:00100000:0.0:1790919079.176676:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919079.176852:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1877914550325248:0@lo:400:kworker.0 00000100:00100000:0.0:1790919079.176882:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919079.176923:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550325376 00000100:00100000:0.0:1790919079.176930:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550325376 00000100:00100000:0.0:1790919079.176972:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790919079.176980:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550325376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919079.177037:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550325248 00000100:00100000:3.0:1790919079.177058:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550325248 00000100:00100000:3.0:1790919079.177089:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1790919079.177096:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877914550325248:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1790919079.177155:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790919079.177160:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790919079.181251:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877914550325248:12345-0@lo:400:kworker.0 Request processed in 4145us (4357us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919079.181266:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1790919079.181367:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1877914550325248:0@lo:400:kworker.0 00000100:00100000:0.0:1790919079.181476:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550325376:12345-0@lo:400:kworker.0 Request processed in 4494us (4797us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919079.181485:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:2.0:1790919079.181575:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88beb3b3ad80 x1877914550325376/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919079.181587:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550325376:0@lo:400:kworker.0 00000100:00100000:2.0:1790919079.679956:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550325504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790919079.680044:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919079.680385:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550325504 00000100:00100000:1.0:1790919079.680394:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550325504 00000100:00100000:1.0:1790919079.680505:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790919079.680516:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebacb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550325504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790919079.680576:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919079.682174:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebacb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550325504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1653us (2135us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919079.682187:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1790919079.682455:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88beb3b3aa00 x1877914550325504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919095 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919079.682479:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550325504:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790919080.194046:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790919080.832703:0:11487:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 01:31:20 (1790919080) === 00000100:00100000:2.0:1790919081.116266:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919081.116374:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919081.116458:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532462848 00000100:00100000:0.0:1790919081.116472:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532462848 00000100:00100000:0.0:1790919081.116585:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 14 00000100:00100000:0.0:1790919081.116599:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebacb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2352:x1877914532462848:12345-192.168.201.27@tcp:41:mkdir.0 00000004:00000024:0.0:1790919081.116660:0:5847:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790919081.116790:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebacb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2352:x1877914532462848:12345-192.168.201.27@tcp:41:mkdir.0 Request processed in 194us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919081.116798:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 14 00000100:00100000:0.0:1790919081.116833:0:5854:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532462976 00000100:00100000:0.0:1790919081.116837:0:5854:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532462976 00000100:00100000:0.0:1790919081.116860:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 0 00000100:00100000:0.0:1790919081.116867:0:5854:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:9658:x1877914532462976:12345-192.168.201.27@tcp:700:mkdir.0 00000100:00100000:0.0:1790919081.116903:0:5854:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:9658:x1877914532462976:12345-192.168.201.27@tcp:700:mkdir.0 Request processed in 37us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919081.116910:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 0 00000100:00080000:2.0:1790919081.120577:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790919081.128558:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919081.128655:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532463232 00000100:00100000:2.0:1790919081.128669:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532463232 00000100:00100000:2.0:1790919081.128748:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 15 00000100:00100000:2.0:1790919081.128769:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf788a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:9658:x1877914532463232:12345-192.168.201.27@tcp:36:mkdir.0 00010000:00010000:2.0:1790919081.128848:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919081.130592:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c423d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672caf4 expref: 6 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.130622:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be85efc400) 00010000:00010000:2.0:1790919081.130654:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790919081.131024:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c435c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.131041:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c435c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.131051:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c435c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.131091:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4363 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.131100:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4363 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.131108:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4363 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919081.140456:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1790919081.140484:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c435c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.140497:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c435c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.140506:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c435c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.140512:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88387a00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919081.140517:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c435c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.141625:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c435c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.141655:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be85efc500) 00010000:00010000:0.0:1790919081.141659:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919081.141666:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c435c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.141685:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c435c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790919081.141715:0:5846:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a88ff057 reply state 00000000654159ee transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4363 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919081.141726:0:5846:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790919081.142322:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf788a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:9658:x1877914532463232:12345-192.168.201.27@tcp:36:mkdir.0 Request processed in 13549us (13798us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1790919081.142334:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 15 00010000:00010000:3.0:1790919081.169238:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4363 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919081.169258:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4363 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919081.169267:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4363 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919081.169273:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386600 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919081.169278:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4363 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919081.169287:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4363 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919081.169305:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff88be85efc000) 00010000:00010000:3.0:1790919081.169309:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919081.169313:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4363 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919081.171600:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4363 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919081.198967:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919081.199055:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532463360 00000100:00100000:0.0:1790919081.199073:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532463360 00000100:00100000:0.0:1790919081.199171:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 16 00000100:00100000:0.0:1790919081.199184:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf788380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:9659:x1877914532463360:12345-192.168.201.27@tcp:101:chmod.0 00010000:00010000:0.0:1790919081.199213:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919081.199245:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146400/0xc3296956897c436a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cb79 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.199349:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81147600/0xc3296956897c4371 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.199368:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81147600/0xc3296956897c4371 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.199384:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81147600/0xc3296956897c4371 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919081.199432:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790919081.199437:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790919081.199518:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81147600/0xc3296956897c4371 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.199586:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146400/0xc3296956897c436a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb79 expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.199609:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81147600/0xc3296956897c4371 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb79 expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.199620:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be853b5e00) 00010000:00010000:0.0:1790919081.199623:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790919081.199627:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bd81147600, rc 0) 00000100:00100000:0.0:1790919081.199737:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf788380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:9659:x1877914532463360:12345-192.168.201.27@tcp:101:chmod.0 Request processed in 554us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919081.199745:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 16 00010000:00010000:2.0:1790919081.218681:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919081.219448:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919081.219746:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532463616 00000100:00100000:3.0:1790919081.219768:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532463616 00000100:00100000:3.0:1790919081.219817:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 17 00000100:00100000:3.0:1790919081.219828:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebfbf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:9659:x1877914532463616:12345-192.168.201.27@tcp:36:chmod.0 00010000:00010000:3.0:1790919081.219883:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919081.219908:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81147600/0xc3296956897c4371 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb79 expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919081.219925:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be853b5e00) 00010000:00010000:3.0:1790919081.219935:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790919081.219959:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c4378 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919081.219971:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c4378 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919081.219981:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c4378 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790919081.220282:0:5845:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005348874e reply state 00000000fbe5f804 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c4378 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919081.220292:0:5845:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1790919081.220300:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1790919081.220396:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebfbf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+8:9659:x1877914532463616:12345-192.168.201.27@tcp:36:chmod.0 Request processed in 569us (952us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1790919081.220404:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 17 00010000:00010000:0.0:1790919081.227447:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c4378 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.227479:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c4378 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.227487:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c4378 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.227493:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81516600 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919081.227498:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c4378 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.227508:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c4378 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.227570:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be88e22200) 00010000:00010000:0.0:1790919081.227574:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790919081.227579:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c4378 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.227585:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c4378 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919081.262948:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919081.263063:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532463744 00000100:00100000:0.0:1790919081.263074:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532463744 00000100:00100000:0.0:1790919081.263133:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 18 00000100:00100000:0.0:1790919081.263143:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebfbf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:9660:x1877914532463744:12345-192.168.201.27@tcp:101:chown.0 00010000:00010000:0.0:1790919081.263167:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919081.263191:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146400/0xc3296956897c437f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cb80 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.263258:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146600/0xc3296956897c4386 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.263272:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146600/0xc3296956897c4386 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.263284:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146600/0xc3296956897c4386 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919081.263331:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790919081.263336:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790919081.263376:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146600/0xc3296956897c4386 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.263420:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146400/0xc3296956897c437f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb80 expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.263437:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146600/0xc3296956897c4386 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb80 expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.263446:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be853b5000) 00010000:00010000:0.0:1790919081.264554:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790919081.264564:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bd81146600, rc 0) 00000100:00100000:3.0:1790919081.264781:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebfbf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+8:9660:x1877914532463744:12345-192.168.201.27@tcp:101:chown.0 Request processed in 1635us (1840us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919081.264801:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 18 00000100:00100000:1.0:1790919081.279148:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919081.279219:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532463872 00000100:00100000:3.0:1790919081.279229:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532463872 00000100:00100000:3.0:1790919081.279284:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 19 00000100:00100000:3.0:1790919081.279295:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebfbf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+8:9660:x1877914532463872:12345-192.168.201.27@tcp:101:chown.0 00010000:00010000:3.0:1790919081.279324:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919081.279346:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517200/0xc3296956897c438d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cb87 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919081.279412:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517000/0xc3296956897c4394 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919081.279427:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517000/0xc3296956897c4394 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919081.279438:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517000/0xc3296956897c4394 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919081.279453:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516e00/0xc3296956897c439b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919081.279460:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516e00/0xc3296956897c439b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919081.279466:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516e00/0xc3296956897c439b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.279738:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516c00/0xc3296956897c43a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.279765:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516c00/0xc3296956897c43a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.279772:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516c00/0xc3296956897c43a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919081.279802:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790919081.279805:0:5845:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790919081.279825:0:5845:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516c00/0xc3296956897c43a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.279836:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517000/0xc3296956897c4394 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.279842:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517000/0xc3296956897c4394 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.279848:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517000/0xc3296956897c4394 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.279854:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81517000 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919081.279857:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517000/0xc3296956897c4394 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.279864:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517000/0xc3296956897c4394 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.279874:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be853b5000) 00010000:00010000:2.0:1790919081.279876:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919081.279880:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517000/0xc3296956897c4394 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.279896:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517000/0xc3296956897c4394 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.279909:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516e00/0xc3296956897c439b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.279915:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516e00/0xc3296956897c439b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.279920:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516e00/0xc3296956897c439b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.279925:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81516e00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919081.279928:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516e00/0xc3296956897c439b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.279934:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516e00/0xc3296956897c439b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.279940:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff88be88e22500) 00010000:00010000:2.0:1790919081.279942:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919081.279944:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516e00/0xc3296956897c439b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.279950:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516e00/0xc3296956897c439b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.279982:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517200/0xc3296956897c438d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb87 expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.279996:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516c00/0xc3296956897c43a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb87 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.280622:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88be88e22000) 00010000:00010000:2.0:1790919081.280625:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790919081.280628:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81516c00, rc 0) 00000100:00100000:2.0:1790919081.280699:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebfbf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+9:9660:x1877914532463872:12345-192.168.201.27@tcp:101:chown.0 Request processed in 1405us (1560us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919081.280707:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 19 00000100:00100000:1.0:1790919081.291796:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919081.291974:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532464128 00000100:00100000:0.0:1790919081.291985:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532464128 00000100:00100000:0.0:1790919081.292063:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 20 00000100:00100000:0.0:1790919081.292075:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebfbf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+9:9660:x1877914532464128:12345-192.168.201.27@tcp:36:chown.0 00010000:00010000:0.0:1790919081.292128:0:8231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919081.292155:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516c00/0xc3296956897c43a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb87 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.292175:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88be88e22000) 00010000:00010000:0.0:1790919081.292187:0:8231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790919081.292211:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146400/0xc3296956897c43a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.292224:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146400/0xc3296956897c43a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.292234:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146400/0xc3296956897c43a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790919081.398131:0:5869:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1790919081.398469:0:8231:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f254f846 reply state 00000000ec1727a0 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146400/0xc3296956897c43a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919081.398483:0:8231:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1790919081.398497:0:8231:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:0.0:1790919081.398833:0:8231:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1790919081.398859:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebfbf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:9660:x1877914532464128:12345-192.168.201.27@tcp:36:chown.0 Request processed in 106782us (107067us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1790919081.398869:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 20 00010000:00010000:2.0:1790919081.398947:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146400/0xc3296956897c43a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.398965:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146400/0xc3296956897c43a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.398973:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146400/0xc3296956897c43a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.398979:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bd81146400 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919081.398984:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146400/0xc3296956897c43a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.398991:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146400/0xc3296956897c43a9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.399015:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88be853b5c00) 00010000:00010000:2.0:1790919081.399019:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790919081.399024:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146400/0xc3296956897c43a9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.399029:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146400/0xc3296956897c43a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919081.426162:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919081.427211:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532464256 00000100:00100000:0.0:1790919081.427226:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532464256 00000100:00100000:0.0:1790919081.427301:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 21 00000100:00100000:0.0:1790919081.427312:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebfbf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:9661:x1877914532464256:12345-192.168.201.27@tcp:101:touch.500 00010000:00010000:0.0:1790919081.427348:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919081.427368:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81147200/0xc3296956897c43b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cb8e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790919081.434046:0:5846:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 6624us 00010000:00010000:0.0:1790919081.487218:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146c00/0xc3296956897c43b7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.487246:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146c00/0xc3296956897c43b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.487260:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146c00/0xc3296956897c43b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.487277:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81147800/0xc3296956897c43be lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.487294:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81147800/0xc3296956897c43be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.487302:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81147800/0xc3296956897c43be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.487682:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81147000/0xc3296956897c43c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.487692:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81147000/0xc3296956897c43c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.487700:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81147000/0xc3296956897c43c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919081.487722:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790919081.487726:0:5846:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790919081.487902:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81147000/0xc3296956897c43c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.487915:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146c00/0xc3296956897c43b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.487922:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146c00/0xc3296956897c43b7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.487929:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146c00/0xc3296956897c43b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.487935:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bd81146c00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919081.487939:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146c00/0xc3296956897c43b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.488132:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146c00/0xc3296956897c43b7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.488149:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be853b5000) 00010000:00010000:0.0:1790919081.488152:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919081.488157:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146c00/0xc3296956897c43b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.488164:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146c00/0xc3296956897c43b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.488176:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81147800/0xc3296956897c43be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.488182:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81147800/0xc3296956897c43be lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.488187:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81147800/0xc3296956897c43be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.488192:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bd81147800 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919081.488195:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81147800/0xc3296956897c43be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.488200:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81147800/0xc3296956897c43be lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.488207:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff88be853b5100) 00010000:00010000:0.0:1790919081.488209:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919081.488212:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81147800/0xc3296956897c43be lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.488229:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81147800/0xc3296956897c43be lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.488272:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81147200/0xc3296956897c43b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb8e expref: 8 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.488286:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81147000/0xc3296956897c43c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb8e expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.488295:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88be853b5b00) 00010000:00010000:0.0:1790919081.488297:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1790919081.488300:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bd81147000, rc 0) 00000100:00100000:0.0:1790919081.488910:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebfbf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:9661:x1877914532464256:12345-192.168.201.27@tcp:101:touch.500 Request processed in 61597us (62756us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919081.488920:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 21 00000100:00100000:0.0:1790919081.499603:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919081.499799:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532464512 00000100:00100000:3.0:1790919081.499810:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532464512 00000100:00100000:3.0:1790919081.499867:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 22 00000100:00100000:3.0:1790919081.499891:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:9661:x1877914532464512:12345-192.168.201.27@tcp:101:touch.500 00010000:00010000:3.0:1790919081.499916:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919081.499937:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516c00/0xc3296956897c43cc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cb95 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919081.500218:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517200/0xc3296956897c43d3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919081.500235:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517200/0xc3296956897c43d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919081.500245:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517200/0xc3296956897c43d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919081.500288:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516e00/0xc3296956897c43da lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919081.500296:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516e00/0xc3296956897c43da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919081.500303:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516e00/0xc3296956897c43da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790919081.507827:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1790919081.508242:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c43e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.508260:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c43e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.508272:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c43e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.508324:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517200/0xc3296956897c43d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.508332:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517200/0xc3296956897c43d3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.508340:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517200/0xc3296956897c43d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.508347:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81517200 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919081.508351:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517200/0xc3296956897c43d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.508360:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517200/0xc3296956897c43d3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.508372:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88be853b5b00) 00010000:00010000:2.0:1790919081.508375:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919081.508380:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517200/0xc3296956897c43d3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.508398:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517200/0xc3296956897c43d3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790919081.508412:0:5847:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007e998dd9 reply state 000000004ae987d7 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516e00/0xc3296956897c43da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919081.508422:0:5847:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790919081.508459:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516c00/0xc3296956897c43cc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb95 expref: 10 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.508475:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c43e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb95 expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.508483:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff88be85efc400) 00010000:00010000:2.0:1790919081.508485:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790919081.508488:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be88386e00, rc 0) 00000100:00100000:2.0:1790919081.508586:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+10:9661:x1877914532464512:12345-192.168.201.27@tcp:101:touch.500 Request processed in 8697us (8994us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1790919081.508596:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 22 00010000:00010000:2.0:1790919081.510198:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516e00/0xc3296956897c43da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.510212:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516e00/0xc3296956897c43da lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.510220:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516e00/0xc3296956897c43da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.510225:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81516e00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919081.510241:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516e00/0xc3296956897c43da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.510248:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516e00/0xc3296956897c43da lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.510262:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x2a24774b (ffff88be88e22100) 00010000:00010000:2.0:1790919081.510265:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919081.510269:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516e00/0xc3296956897c43da lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.510275:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516e00/0xc3296956897c43da lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919081.514478:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919081.515261:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532464768 00000100:00100000:2.0:1790919081.515272:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532464768 00000100:00100000:2.0:1790919081.515331:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 23 00000100:00100000:2.0:1790919081.515342:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+9:9661:x1877914532464768:12345-192.168.201.27@tcp:36:touch.500 00010000:00010000:2.0:1790919081.515394:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919081.515418:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c43e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb95 expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.515437:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff88be85efc400) 00010000:00010000:2.0:1790919081.515448:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790919081.515483:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c43ef lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.515496:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c43ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.515505:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c43ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790919081.515798:0:5845:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001e64700e reply state 00000000992f4606 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c43ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919081.515808:0:5845:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790919081.516025:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+10:9661:x1877914532464768:12345-192.168.201.27@tcp:36:touch.500 Request processed in 684us (1557us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1790919081.516034:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 23 00010000:00010000:0.0:1790919081.519768:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c43ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.519787:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c43ef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.519795:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c43ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.519801:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386c00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919081.519806:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c43ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.519824:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c43ef lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.519842:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff88be85efc900) 00010000:00010000:0.0:1790919081.519845:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919081.519849:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c43ef lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.519856:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c43ef lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919081.526605:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919081.526899:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532464896 00000100:00100000:2.0:1790919081.526910:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532464896 00000100:00100000:2.0:1790919081.526961:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 24 00000100:00100000:2.0:1790919081.526971:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+9:9661:x1877914532464896:12345-192.168.201.27@tcp:101:touch.500 00010000:00010000:2.0:1790919081.526996:0:8231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919081.527033:0:8231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c43f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cb9c expref: -99 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.527100:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c43f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb9c expref: 10 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.527114:0:8231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c43f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb9c expref: 10 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.527133:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff88be85efc700) 00010000:00010000:2.0:1790919081.527136:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790919081.527139:0:8231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be88387200, rc 0) 00000100:00100000:2.0:1790919081.527209:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+10:9661:x1877914532464896:12345-192.168.201.27@tcp:101:touch.500 Request processed in 239us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919081.527217:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 24 00000100:00100000:3.0:1790919081.548257:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919081.548437:0:10350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532465024 00000100:00100000:0.0:1790919081.548447:0:10350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532465024 00000100:00100000:0.0:1790919081.548496:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 16 00000100:00100000:0.0:1790919081.548504:0:10350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2349:x1877914532465024:12345-192.168.201.27@tcp:8:touch.500 00010000:00080000:0.0:1790919081.548575:0:10350:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from c4a4e085-55d7-40e9-993c-11b4dfc2d5f5@192.168.201.27@tcp t0 exp 0000000000000000 cur 283 last 0 00000020:00000080:0.0:1790919081.548607:0:10350:0:(genops.c:1384:class_connect()) connect: client c4a4e085-55d7-40e9-993c-11b4dfc2d5f5, cookie 0xc3296956897c43fd 00002000:00100000:0.0:1790919081.549047:0:10350:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c4a4e085-55d7-40e9-993c-11b4dfc2d5f5/ffff88beb9f1d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790919081.549073:0:10350:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790919081.549298:0:10350:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790919081.549827:0:10350:0:(import.c:65:import_set_state_nolock()) ffff88beb9f1a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790919081.549939:0:10350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2349:x1877914532465024:12345-192.168.201.27@tcp:8:touch.500 Request processed in 1432us (1692us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919081.549949:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 16 00000100:00100000:0.0:1790919081.573199:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919081.573324:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532465152 00000100:00100000:1.0:1790919081.573334:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532465152 00000100:00100000:1.0:1790919081.573409:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 17 00000100:00100000:1.0:1790919081.573419:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:0:x1877914532465152:12345-192.168.201.27@tcp:2:touch.500 00000100:00080000:2.0:1790919081.573880:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:3.0:1790919081.667989:0:6722:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c4a4e085-55d7-40e9-993c-11b4dfc2d5f5 00000001:00080000:3.0:1790919081.668022:0:6722:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:2.0:1790919081.668590:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:0:x1877914532465152:12345-192.168.201.27@tcp:2:touch.500 Request processed in 95164us (95394us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1790919081.668603:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 17 00000100:00100000:0.0:1790919081.677437:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919081.677649:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532465408 00000100:00100000:2.0:1790919081.677660:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532465408 00000100:00100000:2.0:1790919081.677715:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 2 00000100:00100000:2.0:1790919081.677726:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+10:9661:x1877914532465408:12345-192.168.201.27@tcp:35:touch.500 00000100:00100000:2.0:1790919081.678402:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+11:9661:x1877914532465408:12345-192.168.201.27@tcp:35:touch.500 Request processed in 675us (973us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1790919081.678411:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 2 00000100:00100000:3.0:1790919081.691651:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919081.691769:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532465536 00000100:00100000:0.0:1790919081.691781:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532465536 00000100:00100000:0.0:1790919081.691842:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 25 00000100:00100000:0.0:1790919081.691853:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+11:9662:x1877914532465536:12345-192.168.201.27@tcp:101:rm.0 00010000:00010000:0.0:1790919081.691880:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919081.691900:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146c00/0xc3296956897c4404 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cba3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.691978:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146a00/0xc3296956897c440b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.691993:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146a00/0xc3296956897c440b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.692013:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146a00/0xc3296956897c440b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919081.692056:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790919081.692060:0:5846:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790919081.692097:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146a00/0xc3296956897c440b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.692134:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146c00/0xc3296956897c4404 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cba3 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.692154:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146a00/0xc3296956897c440b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cba3 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.692163:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88be853b5b00) 00010000:00010000:0.0:1790919081.692166:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790919081.692184:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bd81146a00, rc 0) 00000100:00100000:0.0:1790919081.692262:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+12:9662:x1877914532465536:12345-192.168.201.27@tcp:101:rm.0 Request processed in 410us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919081.692268:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 25 00000100:00100000:1.0:1790919081.702506:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919081.702641:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532465792 00000100:00100000:2.0:1790919081.702652:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532465792 00000100:00100000:2.0:1790919081.702710:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 26 00000100:00100000:2.0:1790919081.702721:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88db6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+12:9662:x1877914532465792:12345-192.168.201.27@tcp:101:rm.0 00010000:00010000:2.0:1790919081.702743:0:8231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919081.702775:0:8231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c4412 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cbaa expref: -99 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919081.702869:0:8231:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1790919081.703068:0:8231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c4412 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cbaa expref: 14 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.703083:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be853b5000) 00010000:00010000:2.0:1790919081.703086:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790919081.703091:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c4412 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cbaa expref: 14 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.703116:0:8231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be88386e00, rc 0) 00000100:00100000:2.0:1790919081.703179:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88db6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+13:9662:x1877914532465792:12345-192.168.201.27@tcp:101:rm.0 Request processed in 460us (683us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1790919081.703186:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 26 00000100:00100000:1.0:1790919081.709696:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919081.710286:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532465920 00000100:00100000:2.0:1790919081.710297:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532465920 00000100:00100000:2.0:1790919081.710349:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 3 00000100:00100000:2.0:1790919081.710357:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+13:9662:x1877914532465920:12345-192.168.201.27@tcp:37:rm.0 00000100:00100000:2.0:1790919081.721677:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+13:9662:x1877914532465920:12345-192.168.201.27@tcp:37:rm.0 Request processed in 11309us (11978us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919081.721691:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 3 00000100:00100000:1.0:1790919081.726622:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919081.726717:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532466176 00000100:00100000:0.0:1790919081.726729:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532466176 00000100:00100000:0.0:1790919081.726798:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 4 00000100:00100000:0.0:1790919081.726809:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be92909450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+13:9662:x1877914532466176:12345-192.168.201.27@tcp:35:rm.0 00000100:00100000:0.0:1790919081.727123:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be92909450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+14:9662:x1877914532466176:12345-192.168.201.27@tcp:35:rm.0 Request processed in 315us (510us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1790919081.727131:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 4 00000100:00100000:2.0:1790919081.728400:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550325632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790919081.728462:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919081.728629:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550325632 00000100:00100000:3.0:1790919081.728635:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550325632 00000100:00100000:3.0:1790919081.728699:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790919081.728708:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550325632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790919081.728752:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1790919081.728822:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790919081.732629:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550325632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3909us (4154us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919081.732646:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790919081.732808:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919081.732884:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532466432 00000100:00100000:0.0:1790919081.732894:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532466432 00000100:00100000:0.0:1790919081.732948:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 27 00000100:00100000:0.0:1790919081.732966:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88db5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+14:9662:x1877914532466432:12345-192.168.201.27@tcp:101:rm.0 00010000:00010000:0.0:1790919081.732991:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919081.733022:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146c00/0xc3296956897c4420 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cbb1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.733133:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81147a00/0xc3296956897c4427 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.733149:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81147a00/0xc3296956897c4427 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.733161:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81147a00/0xc3296956897c4427 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919081.733199:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1790919081.733573:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146c00/0xc3296956897c4420 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cbb1 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.733592:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81147a00/0xc3296956897c4427 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cbb1 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.733601:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88be853b5b00) 00010000:00010000:0.0:1790919081.733603:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790919081.733607:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bd81147a00, rc 0) 00000100:00100000:0.0:1790919081.733671:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88db5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+16:9662:x1877914532466432:12345-192.168.201.27@tcp:101:rm.0 Request processed in 707us (865us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1790919081.733678:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 27 00000100:00100000:1.0:1790919081.737706:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919081.737792:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532466560 00000100:00100000:0.0:1790919081.737803:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532466560 00000100:00100000:0.0:1790919081.737865:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 28 00000100:00100000:0.0:1790919081.737876:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+16:9662:x1877914532466560:12345-192.168.201.27@tcp:41:rm.0 00000004:00000024:0.0:1790919081.737944:0:8231:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1790919081.738038:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+16:9662:x1877914532466560:12345-192.168.201.27@tcp:41:rm.0 Request processed in 163us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919081.738047:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 28 00000100:00100000:1.0:1790919081.743581:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919081.743668:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532466688 00000100:00100000:0.0:1790919081.743679:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532466688 00000100:00100000:0.0:1790919081.743735:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 29 00000100:00100000:0.0:1790919081.743754:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88db6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+16:9662:x1877914532466688:12345-192.168.201.27@tcp:101:rm.0 00010000:00010000:0.0:1790919081.743793:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919081.743814:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81147800/0xc3296956897c4435 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cbb8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.743877:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81147200/0xc3296956897c443c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.743891:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81147200/0xc3296956897c443c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.743902:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81147200/0xc3296956897c443c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.743915:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146400/0xc3296956897c4443 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x2a24774b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.743921:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146400/0xc3296956897c4443 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.743927:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146400/0xc3296956897c4443 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.744392:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81147600/0xc3296956897c444a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.744403:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81147600/0xc3296956897c444a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.744410:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81147600/0xc3296956897c444a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919081.744436:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1790919081.744447:0:5846:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790919081.744470:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81147600/0xc3296956897c444a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.744482:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81147600/0xc3296956897c444a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.744489:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81147200/0xc3296956897c443c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.744494:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81147200/0xc3296956897c443c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.744500:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81147200/0xc3296956897c443c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.744505:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bd81147200 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919081.744510:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81147200/0xc3296956897c443c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.744516:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81147200/0xc3296956897c443c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.745868:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88be853b5b00) 00010000:00010000:0.0:1790919081.745878:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919081.745885:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81147200/0xc3296956897c443c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.745895:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81147200/0xc3296956897c443c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.745914:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146400/0xc3296956897c4443 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.745939:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146400/0xc3296956897c4443 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.745947:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146400/0xc3296956897c4443 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.746309:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bd81146400 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919081.746314:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146400/0xc3296956897c4443 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.746323:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146400/0xc3296956897c4443 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.746334:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x2a24774b (ffff88be853b5100) 00010000:00010000:0.0:1790919081.746337:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919081.746340:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146400/0xc3296956897c4443 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.746346:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146400/0xc3296956897c4443 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.746392:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81147800/0xc3296956897c4435 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cbb8 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.746407:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81147600/0xc3296956897c444a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cbb8 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.746414:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff88be85efc700) 00010000:00010000:0.0:1790919081.746416:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790919081.746426:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bd81147600, rc 0) 00000100:00100000:0.0:1790919081.746590:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88db6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+17:9662:x1877914532466688:12345-192.168.201.27@tcp:101:rm.0 Request processed in 2845us (3019us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919081.746599:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 29 00010000:00080000:2.0:1790919081.747127:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88beb3b39880 x1877914550325632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919097 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919081.747149:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550325632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790919081.751822:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919081.751908:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532466944 00000100:00100000:0.0:1790919081.751920:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532466944 00000100:00100000:0.0:1790919081.752005:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 30 00000100:00100000:0.0:1790919081.752016:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+17:9662:x1877914532466944:12345-192.168.201.27@tcp:36:rm.0 00010000:00010000:0.0:1790919081.752076:0:8231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1790919081.752104:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81147600/0xc3296956897c444a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cbb8 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.752128:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c43f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb9c expref: 16 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.752140:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff88be85efc700) 00010000:00010000:0.0:1790919081.752158:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146a00/0xc3296956897c440b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cba3 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.752169:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88be853b5b00) 00010000:00010000:0.0:1790919081.752173:0:8231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790919081.752197:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146c00/0xc3296956897c4451 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.752212:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146c00/0xc3296956897c4451 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.752222:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146c00/0xc3296956897c4451 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.752284:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59600/0xc3296956897c4458 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.752293:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59600/0xc3296956897c4458 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.752300:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59600/0xc3296956897c4458 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.752403:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58e00/0xc3296956897c445f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.752411:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58e00/0xc3296956897c445f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.752418:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58e00/0xc3296956897c445f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790919081.755717:0:8231:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1790919081.755752:0:8231:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 283644223835ns, next at 284644211389ns, rc = 0 00010000:00010000:1.0:1790919081.755831:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f000/0xc3296956897c4466 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919081.755849:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f000/0xc3296956897c4466 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919081.755862:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f000/0xc3296956897c4466 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919081.755871:0:8231:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f000/0xc3296956897c4466 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919081.755878:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f000/0xc3296956897c4466 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919081.755884:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f000/0xc3296956897c4466 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919081.755947:0:8231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790919081.756063:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58e00/0xc3296956897c445f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919081.756072:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58e00/0xc3296956897c445f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919081.756079:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58e00/0xc3296956897c445f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919081.756086:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac58e00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:1.0:1790919081.756091:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58e00/0xc3296956897c445f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919081.756111:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58e00/0xc3296956897c445f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919081.756124:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff88be853b5400) 00010000:00010000:1.0:1790919081.756128:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1790919081.756133:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58e00/0xc3296956897c445f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919081.756140:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58e00/0xc3296956897c445f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919081.756160:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146c00/0xc3296956897c4451 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919081.756168:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146c00/0xc3296956897c4451 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919081.756175:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146c00/0xc3296956897c4451 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919081.756180:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bd81146c00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:1.0:1790919081.756183:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146c00/0xc3296956897c4451 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919081.756190:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146c00/0xc3296956897c4451 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919081.756198:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88be853b5b00) 00010000:00010000:1.0:1790919081.756201:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919081.756204:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146c00/0xc3296956897c4451 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919081.756221:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146c00/0xc3296956897c4451 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790919081.756233:0:8231:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000032b0888a reply state 00000000e579b423 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59600/0xc3296956897c4458 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919081.756242:0:8231:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790919081.756341:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+16:9662:x1877914532466944:12345-192.168.201.27@tcp:36:rm.0 Request processed in 4322us (4525us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1790919081.756351:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 30 00010000:00010000:2.0:1790919081.761397:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59600/0xc3296956897c4458 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.761418:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59600/0xc3296956897c4458 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.761426:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59600/0xc3296956897c4458 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.761453:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac59600 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919081.761458:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59600/0xc3296956897c4458 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.761467:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59600/0xc3296956897c4458 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.761483:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x2a24774b (ffff88be853b5700) 00010000:00010000:2.0:1790919081.761487:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919081.761492:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59600/0xc3296956897c4458 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919081.761513:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59600/0xc3296956897c4458 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919081.762063:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00010000:00010000:0.0:1790919081.762627:0:7650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919081.762635:0:7650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f000/0xc3296956897c4466 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.762643:0:7650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88beb3f7f000 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:0.0:1790919081.762646:0:7650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f000/0xc3296956897c4466 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.762654:0:7650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f000/0xc3296956897c4466 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.762666:0:7650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff88be853b5400) 00010000:00010000:0.0:1790919081.762669:0:7650:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790919081.762684:0:7650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f000/0xc3296956897c4466 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.762690:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f000/0xc3296956897c4466 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.762710:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919081.762712:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919081.762714:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919081.762866:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532467200 00000100:00100000:3.0:1790919081.762878:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532467200 00000100:00100000:3.0:1790919081.762976:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 5 00000100:00100000:3.0:1790919081.762987:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+15:9662:x1877914532467200:12345-192.168.201.27@tcp:35:rm.0 00000100:00100000:3.0:1790919081.763481:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+16:9662:x1877914532467200:12345-192.168.201.27@tcp:35:rm.0 Request processed in 493us (1430us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1790919081.763490:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 5 00000100:00100000:2.0:1790919081.770919:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919081.771098:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532467456 00000100:00100000:3.0:1790919081.771177:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532467456 00000100:00100000:3.0:1790919081.771339:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 31 00000100:00100000:3.0:1790919081.771350:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+16:9662:x1877914532467456:12345-192.168.201.27@tcp:36:rm.0 00010000:00010000:3.0:1790919081.771412:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1790919081.771440:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81147a00/0xc3296956897c4427 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cbb1 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919081.771460:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81147000/0xc3296956897c43c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb8e expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919081.771470:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88be853b5b00) 00010000:00010000:3.0:1790919081.771484:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bd81146600/0xc3296956897c4386 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb80 expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919081.771510:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be853b5000) 00010000:00010000:3.0:1790919081.771516:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790919081.771575:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517000/0xc3296956897c446d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919081.771589:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517000/0xc3296956897c446d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919081.771598:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517000/0xc3296956897c446d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919081.771609:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c4474 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919081.771615:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c4474 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919081.771620:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c4474 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919081.771857:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516e00/0xc3296956897c447b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919081.771865:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516e00/0xc3296956897c447b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919081.771872:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516e00/0xc3296956897c447b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919081.773456:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1790919081.773478:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516e00/0xc3296956897c447b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919081.773494:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516e00/0xc3296956897c447b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919081.773500:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516e00/0xc3296956897c447b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919081.773506:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81516e00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919081.773511:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516e00/0xc3296956897c447b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919081.773520:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516e00/0xc3296956897c447b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919081.773668:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88be88e22f00) 00010000:00010000:3.0:1790919081.773671:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1790919081.773675:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516e00/0xc3296956897c447b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919081.773681:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516e00/0xc3296956897c447b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919081.773705:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517000/0xc3296956897c446d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919081.773712:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517000/0xc3296956897c446d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919081.773718:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517000/0xc3296956897c446d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919081.773723:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81517000 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919081.773733:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517000/0xc3296956897c446d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919081.773809:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517000/0xc3296956897c446d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919081.773821:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be88e22300) 00010000:00010000:3.0:1790919081.773823:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919081.773827:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517000/0xc3296956897c446d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919081.773833:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517000/0xc3296956897c446d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790919081.773848:0:5845:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001077e41a reply state 00000000a06a33e7 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c4474 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919081.773858:0:5845:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790919081.774379:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+15:9662:x1877914532467456:12345-192.168.201.27@tcp:36:rm.0 Request processed in 3025us (3465us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1790919081.774390:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 31 00010000:00010000:0.0:1790919081.784737:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c4474 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.784768:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c4474 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.784776:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c4474 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.784782:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81516600 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919081.784787:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c4474 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.784795:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c4474 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.784810:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff88be88e22900) 00010000:00010000:0.0:1790919081.784813:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919081.784818:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c4474 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919081.784824:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c4474 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919082.241120:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919082.714830:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919082.714884:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919082.714915:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919082.714954:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919082.715088:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532467712 00000100:00100000:1.0:1790919082.715099:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532467712 00000100:00100000:1.0:1790919082.715159:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532467968 00000100:00100000:1.0:1790919082.715162:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532467968 00000100:00100000:1.0:1790919082.715195:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 99 00000100:00100000:1.0:1790919082.715205:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+14:2351:x1877914532467712:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:1.0:1790919082.715286:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+14:2351:x1877914532467712:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 82us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919082.715295:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 99 00000100:00100000:1.0:1790919082.715313:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 100 00000100:00100000:1.0:1790919082.715319:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5591729f-44f1-43f1-b042-c3a508737d97+5:2351:x1877914532467968:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:1.0:1790919082.715348:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5591729f-44f1-43f1-b042-c3a508737d97+5:2351:x1877914532467968:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 29us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919082.715370:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 100 00000100:00080000:1.0:1790919082.715388:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790919082.715717:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532467584 00000100:00100000:3.0:1790919082.715722:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532467584 00000100:00100000:3.0:1790919082.715761:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 248 00000100:00100000:3.0:1790919082.715768:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be86bb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+13:2351:x1877914532467584:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1790919082.715806:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be86bb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+13:2351:x1877914532467584:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 39us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919082.715812:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 248 00000100:00100000:0.0:1790919082.716911:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532467840 00000100:00100000:0.0:1790919082.716922:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532467840 00000100:00100000:0.0:1790919082.716972:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 55 00000100:00100000:0.0:1790919082.716989:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2351:x1877914532467840:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:0.0:1790919082.717059:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2351:x1877914532467840:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 80us (2174us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919082.717066:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 55 00010000:00010000:2.0:1790919083.264114:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919084.288932:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3308:1877914550325760:0@lo:400:kworker.0 00000100:00100000:3.0:1790919084.289017:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919084.289067:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1877914550326272:0@lo:400:kworker.0 00000100:00100000:3.0:1790919084.289096:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919084.289129:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790919084.289134:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550326144:0@lo:400:kworker.0 00000100:00100000:3.0:1790919084.289156:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919084.289186:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877914550325888:0@lo:400:kworker.0 00000100:00100000:3.0:1790919084.289208:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919084.289221:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb413bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550326400:0@lo:400:kworker.0 00000100:00100000:3.0:1790919084.289239:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919084.289256:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790919084.289261:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1877914550326016:0@lo:400:kworker.0 00000100:00100000:3.0:1790919084.289280:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919084.289306:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550326144 00000100:00100000:3.0:1790919084.289314:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550326144 00000100:00100000:3.0:1790919084.289359:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550326400 00000100:00100000:3.0:1790919084.289362:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550326400 00000100:00100000:3.0:1790919084.289383:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790919084.289391:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb413aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550326144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919084.289440:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb413aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550326144:12345-0@lo:400:kworker.0 Request processed in 50us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919084.289448:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790919084.289464:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790919084.289469:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4138e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550326400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919084.289497:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4138e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550326400:12345-0@lo:400:kworker.0 Request processed in 28us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919084.289503:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1790919084.289565:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88beb413bb80 x1877914550326400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919084.289578:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb413bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550326400:0@lo:400:kworker.0 00010000:00080000:3.0:1790919084.289610:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88beb3b64e00 x1877914550326144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919084.289618:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550326144:0@lo:400:kworker.0 00010000:00010000:1.0:1790919084.289705:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919084.289718:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550325760 00000100:00100000:1.0:1790919084.289721:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550325760 00000100:00100000:1.0:1790919084.289757:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1790919084.289764:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be86bb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3308:x1877914550325760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919084.289803:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be86bb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3308:x1877914550325760:12345-0@lo:400:kworker.0 Request processed in 39us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919084.289810:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1790919084.289836:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550326272 00000100:00100000:1.0:1790919084.289839:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550326272 00000100:00100000:1.0:1790919084.289863:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550325888 00000100:00100000:1.0:1790919084.289866:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550325888 00000100:00100000:1.0:1790919084.289875:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550326016 00000100:00100000:1.0:1790919084.289877:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550326016 00000100:00100000:1.0:1790919084.289889:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1790919084.289894:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4138380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877914550326272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919084.289922:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4138380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877914550326272:12345-0@lo:400:kworker.0 Request processed in 28us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919084.289927:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1790919084.289939:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790919084.289944:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4139c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877914550325888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919084.289987:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4139c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877914550325888:12345-0@lo:400:kworker.0 Request processed in 42us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919084.289993:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790919084.290004:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790919084.290016:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4139880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877914550326016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919084.290044:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4139880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877914550326016:12345-0@lo:400:kworker.0 Request processed in 29us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919084.290049:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:1.0:1790919084.290070:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790919084.290074:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790919084.290076:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790919084.290096:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1877914550326016:0@lo:400:kworker.0 00000100:00100000:1.0:1790919084.290105:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877914550325888:0@lo:400:kworker.0 00000100:00100000:1.0:1790919084.290127:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3308:1877914550325760:0@lo:400:kworker.0 00000100:00100000:1.0:1790919084.290136:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1877914550326272:0@lo:400:kworker.0 00000100:00100000:1.0:1790919084.805823:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790919084.805845:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88db4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550326528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790919084.805926:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919084.806000:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550326528 00000100:00100000:1.0:1790919084.806008:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550326528 00000100:00100000:1.0:1790919084.806050:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790919084.806060:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550326528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790919084.806094:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919084.806141:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550326528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919084.806148:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1790919084.806188:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88be88db4e00 x1877914550326528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919100 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919084.806206:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88db4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550326528:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790919085.315287:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790919085.907317:0:11639:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1790919086.338523:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790919086.383392:0:5869:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967305 is committed 00000001:00080000:0.0:1790919086.383409:0:5869:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:0.0:1790919086.383413:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:0.0:1790919086.383435:0:5869:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:0.0:1790919086.383584:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550326656:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1790919086.383645:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919086.383719:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550326656 00000100:00100000:0.0:1790919086.383726:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550326656 00000100:00100000:0.0:1790919086.383773:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790919086.383781:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550326656:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1790919086.383805:0:6700:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1790919086.383833:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6abf41aa, atime: 0x6abf41aa, ctime: 0x6abf41aa, blocks: 0x1 00010000:00010000:0.0:1790919086.383842:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c4482 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919086.383857:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=288s v=(0 0) 00010000:00010000:0.0:1790919086.383861:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919086.383867:0:6700:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c4482 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919086.383901:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c4482 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919086.383912:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c4482 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919086.383932:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c4482 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919086.383949:0:6700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790919086.384414:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1877914550326656:12345-0@lo:6:osp-syn-0-0.0 Request processed in 632us (767us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1790919086.384422:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1790919086.384447:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790919086.384458:0:7650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919086.384465:0:7650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c4482 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919086.384474:0:7650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac58800 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:0.0:1790919086.384478:0:7650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c4482 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919086.384487:0:7650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c4482 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919086.384513:0:7650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c4482 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919086.384521:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c4482 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919086.384563:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919086.384564:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919086.384566:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1790919086.384594:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88beb3b39880/2, rc 0, transno 4294967300 00000100:00100000:0.0:1790919086.384616:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550326656:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1790919086.851072:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550326784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790919086.851144:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919086.851215:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550326784 00000100:00100000:1.0:1790919086.851222:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550326784 00000100:00100000:1.0:1790919086.851270:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790919086.851280:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1877914550326784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790919086.851316:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919086.851361:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1877914550326784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919086.851368:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790919086.851422:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550326784:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1790919086.977175:0:6722:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000020:00000080:3.0:1790919087.020734:0:11690:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff7e1f1750 20000000:00000080:3.0:1790919087.020752:0:11690:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff88bebf775c00 uarg=0000000000000000 20000000:01000000:3.0:1790919087.020787:0:11690:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1790919087.020793:0:11690:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1790919087.020798:0:11690:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1790919087.021937:0:11691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1790919087.022071:0:11690:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1790919087.027043:0:11690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1790919087.027102:0:11690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1790919087.027161:0:11690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1790919087.027180:0:11690:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1790919087.027202:0:11690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88be88386e00/0xc3296956897c4489 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919087.027232:0:11690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88beb3f7fc00/0xc3296956897c432b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c4324 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919087.027241:0:11690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88be88386a00/0xc3296956897c4339 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c4332 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919087.027247:0:11690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88be88386200/0xc3296956897c4347 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c4340 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919087.027256:0:11690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88be88387c00/0xc3296956897c434e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb6b expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919087.027263:0:11690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88beb3f7ee00/0xc3296956897c4355 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb72 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919087.027269:0:11690:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88be88386e00/0xc3296956897c4489 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919087.027309:0:11690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88beb3f7ee00/0xc3296956897c4355 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb72 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919087.027325:0:11690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88beb3f7ee00/0xc3296956897c4355 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb72 expref: 12 pid: 5840 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919087.027339:0:11690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11690:1877914550326912:192.168.201.27@tcp:104: 00010000:00010000:2.0:1790919087.027457:0:11690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88be88387c00/0xc3296956897c434e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb6b expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919087.027466:0:11690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88be88387c00/0xc3296956897c434e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb6b expref: 12 pid: 5838 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919087.027484:0:11690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11690:1877914550327040:192.168.201.27@tcp:104: 00010000:00010000:2.0:1790919087.027518:0:11690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88be88386200/0xc3296956897c4347 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3296956897c4340 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919087.027564:0:11690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88be88386200/0xc3296956897c4347 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3296956897c4340 expref: 18 pid: 5839 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919087.027574:0:11690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11690:1877914550327168:0@lo:104: 00000100:00100000:2.0:1790919087.027617:0:11690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790919087.027663:0:11690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88be88386a00/0xc3296956897c4339 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3296956897c4332 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919087.027672:0:11690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88be88386a00/0xc3296956897c4339 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3296956897c4332 expref: 18 pid: 5838 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919087.027680:0:11690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11690:1877914550327296:0@lo:104: 00000100:00100000:2.0:1790919087.027703:0:11690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919087.027744:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550327168 00000100:00100000:2.0:1790919087.027753:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550327168 00000100:00100000:2.0:1790919087.027791:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550327296 00000100:00100000:2.0:1790919087.027793:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550327296 00000100:00100000:2.0:1790919087.027806:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790919087.027814:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+4:11690:x1877914550327168:12345-0@lo:104: 00010000:00010000:2.0:1790919087.027826:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.127@tcp lock: ffff88be81516800/0xc3296956897c4340 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c4347 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919087.027870:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790919087.027876:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+4:11690:x1877914550327168:12345-0@lo:104: Request processed in 62us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919087.027891:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790919087.027921:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790919087.027927:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+3:11690:x1877914550327296:12345-0@lo:104: 00010000:00010000:2.0:1790919087.027934:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.127@tcp lock: ffff88beb3f7f600/0xc3296956897c4332 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c4339 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919087.027968:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790919087.027973:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+3:11690:x1877914550327296:12345-0@lo:104: Request processed in 48us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919087.027979:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1790919087.027996:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790919087.028002:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff88be81516800/0xc3296956897c4340 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c4347 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919087.028010:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81516800 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:2.0:1790919087.028014:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff88be81516800/0xc3296956897c4340 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3296956897c4347 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919087.028023:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff88be81516800/0xc3296956897c4340 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3296956897c4347 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790919087.028031:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff88be81516800/0xc3296956897c4340 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3296956897c4347 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919087.028036:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790919087.028065:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff88be81516800/0xc3296956897c4340 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c4347 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919087.028072:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790919087.028100:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff88be81516800/0xc3296956897c4340 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c4347 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919087.028108:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff88be81516800/0xc3296956897c4340 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c4347 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919087.028122:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919087.028125:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff88beb3f7f600/0xc3296956897c4332 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c4339 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919087.028131:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88beb3f7f600 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:2.0:1790919087.028134:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff88beb3f7f600/0xc3296956897c4332 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3296956897c4339 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919087.028141:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff88beb3f7f600/0xc3296956897c4332 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3296956897c4339 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790919087.028148:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff88beb3f7f600/0xc3296956897c4332 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3296956897c4339 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919087.028153:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790919087.028168:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff88beb3f7f600/0xc3296956897c4332 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c4339 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919087.028174:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790919087.028181:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff88beb3f7f600/0xc3296956897c4332 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c4339 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919087.028187:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff88beb3f7f600/0xc3296956897c4332 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c4339 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919087.028199:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919087.028206:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919087.028208:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919087.028229:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf6e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3306:1877914550327552:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790919087.028260:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919087.028285:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790919087.028291:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3306:1877914550327424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790919087.028314:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919087.028343:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550327552 00000100:00100000:2.0:1790919087.028347:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550327552 00010000:00010000:2.0:1790919087.028373:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88be88386a00/0xc3296956897c4339 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c4332 expref: 19 pid: 5838 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919087.028393:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550327424 00000100:00100000:2.0:1790919087.028396:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550327424 00010000:00010000:2.0:1790919087.028407:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88be88386200/0xc3296956897c4347 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c4340 expref: 20 pid: 5839 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919087.028423:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790919087.028430:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+20:3306:x1877914550327552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790919087.028441:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919087.028446:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88be88386a00/0xc3296956897c4339 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c4332 expref: 20 pid: 5838 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919087.028455:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88be88386a00/0xc3296956897c4339 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3296956897c4332 expref: 20 pid: 5838 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919087.028469:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919087.028498:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+20:3306:x1877914550327552:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919087.028505:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790919087.028562:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790919087.028569:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3306:x1877914550327424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790919087.028578:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919087.028583:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88be88386200/0xc3296956897c4347 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c4340 expref: 19 pid: 5839 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919087.028590:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88be88386200/0xc3296956897c4347 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3296956897c4340 expref: 19 pid: 5839 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919087.028599:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919087.028621:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3306:x1877914550327424:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919087.028626:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790919087.028662:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3306:1877914550327424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790919087.028671:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf6e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3306:1877914550327552:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790919087.028711:0:11690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88beb3f7fc00/0xc3296956897c432b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3296956897c4324 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919087.028722:0:11690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88beb3f7fc00/0xc3296956897c432b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3296956897c4324 expref: 18 pid: 5840 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919087.028730:0:11690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf6e1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11690:1877914550327680:0@lo:104: 00000100:00100000:2.0:1790919087.028755:0:11690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919087.028781:0:5828:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1790919087.028790:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550327680 00000100:00100000:2.0:1790919087.028793:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550327680 00000100:00100000:2.0:1790919087.028810:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790919087.028816:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebaa28450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+3:11690:x1877914550327680:12345-0@lo:104: 00010000:00010000:2.0:1790919087.028830:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.127@tcp lock: ffff88bd81146000/0xc3296956897c4324 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c432b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919087.028864:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790919087.028870:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebaa28450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+3:11690:x1877914550327680:12345-0@lo:104: Request processed in 54us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919087.028875:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790919087.028934:0:11690:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beadae5e40 going to sleep for 11 seconds 00010000:00010000:2.0:1790919087.028948:0:11690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be88386200/0xc3296956897c4347 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3296956897c4340 expref: 18 pid: 5839 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919087.028958:0:11690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11690:1877914550327168:0@lo:104: 00010000:00010000:2.0:1790919087.028965:0:11690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be88386a00/0xc3296956897c4339 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3296956897c4332 expref: 17 pid: 5838 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919087.028971:0:11690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11690:1877914550327296:0@lo:104: 00000100:00100000:2.0:1790919087.028977:0:11690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf6e1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11690:1877914550327680:0@lo:104: 00010000:00010000:1.0:1790919087.029241:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919087.029247:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff88bd81146000/0xc3296956897c4324 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c432b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919087.029254:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bd81146000 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:1.0:1790919087.029258:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff88bd81146000/0xc3296956897c4324 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3296956897c432b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919087.029265:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff88bd81146000/0xc3296956897c4324 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3296956897c432b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790919087.029272:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff88bd81146000/0xc3296956897c4324 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3296956897c432b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919087.029278:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790919087.029304:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff88bd81146000/0xc3296956897c4324 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c432b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919087.029317:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790919087.029345:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff88bd81146000/0xc3296956897c4324 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c432b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919087.029351:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff88bd81146000/0xc3296956897c4324 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c432b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919087.029364:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919087.029366:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919087.029367:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919087.029383:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790919087.029394:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3308:1877914550327808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790919087.029424:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919087.029449:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550327808 00000100:00100000:1.0:1790919087.029453:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550327808 00010000:00010000:1.0:1790919087.029470:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88beb3f7fc00/0xc3296956897c432b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c4324 expref: 17 pid: 5840 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919087.029490:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790919087.029496:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be91caf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:3308:x1877914550327808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790919087.029504:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919087.029508:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88beb3f7fc00/0xc3296956897c432b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c4324 expref: 17 pid: 5840 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919087.029515:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88beb3f7fc00/0xc3296956897c432b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3296956897c4324 expref: 17 pid: 5840 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919087.029549:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88beb3f7fc00/0xc3296956897c432b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3296956897c4324 expref: 17 pid: 5840 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919087.029570:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919087.029601:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be91caf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+16:3308:x1877914550327808:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919087.029607:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790919087.029659:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3308:1877914550327808:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790919087.030290:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919087.037891:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919087.037994:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919087.038079:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532468096 00000100:00100000:0.0:1790919087.038091:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532468096 00010000:00010000:0.0:1790919087.038135:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88be88387c00/0xc3296956897c434e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb6b expref: 13 pid: 5838 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919087.038171:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532468224 00000100:00100000:0.0:1790919087.038175:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532468224 00010000:00010000:0.0:1790919087.038187:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88beb3f7ee00/0xc3296956897c4355 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb72 expref: 14 pid: 5840 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919087.038206:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 33 00000100:00100000:0.0:1790919087.038216:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:002ffd4e-702a-440d-a423-3e840d72bb2e+14:2352:x1877914532468096:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790919087.038230:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919087.038235:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88be88387c00/0xc3296956897c434e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb6b expref: 14 pid: 5838 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919087.038258:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88be88387c00/0xc3296956897c434e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb6b expref: 14 pid: 5838 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919087.038278:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919087.038333:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:002ffd4e-702a-440d-a423-3e840d72bb2e+14:2352:x1877914532468096:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 118us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919087.038340:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 33 00000100:00100000:0.0:1790919087.038360:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 34 00000100:00100000:0.0:1790919087.038367:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:002ffd4e-702a-440d-a423-3e840d72bb2e+13:2352:x1877914532468224:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790919087.038375:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919087.038380:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88beb3f7ee00/0xc3296956897c4355 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb72 expref: 13 pid: 5840 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919087.038389:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88beb3f7ee00/0xc3296956897c4355 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb72 expref: 13 pid: 5840 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919087.038412:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88be88386e00/0xc3296956897c4489 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919087.038421:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be88386e00/0xc3296956897c4489 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919087.038437:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88be88386e00/0xc3296956897c4489 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919087.038443:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88be88386e00/0xc3296956897c4489 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919087.038451:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88be88386e00/0xc3296956897c4489 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919087.038464:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88be88386e00/0xc3296956897c4489 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919087.038471:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386e00 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:0.0:1790919087.038475:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88be88386e00/0xc3296956897c4489 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919087.038484:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88be88386e00/0xc3296956897c4489 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919087.038493:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88be88386e00/0xc3296956897c4489 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919087.038503:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919087.038554:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:002ffd4e-702a-440d-a423-3e840d72bb2e+13:2352:x1877914532468224:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 159us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919087.038562:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 34 00010000:00010000:2.0:1790919087.039155:0:11690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be88387c00/0xc3296956897c434e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb6b expref: 12 pid: 5838 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919087.039170:0:11690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11690:1877914550327040:192.168.201.27@tcp:104: 00010000:00010000:2.0:1790919087.039183:0:11690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88beb3f7ee00/0xc3296956897c4355 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb72 expref: 11 pid: 5840 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919087.039192:0:11690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11690:1877914550326912:192.168.201.27@tcp:104: 00010000:00010000:2.0:1790919087.039223:0:11690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88be88386e00/0xc3296956897c4489 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919087.039244:0:11690:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88be88386e00/0xc3296956897c4489 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919087.039250:0:11690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88be88386e00/0xc3296956897c4489 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919087.039255:0:11690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be88386e00/0xc3296956897c4489 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919087.359760:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919087.823093:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919087.823139:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919087.823168:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919087.823206:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919087.823239:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532468480 00000100:00100000:1.0:1790919087.823251:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532468480 00000100:00100000:1.0:1790919087.823310:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532468736 00000100:00100000:1.0:1790919087.823314:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532468736 00000100:00100000:1.0:1790919087.823337:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 104 00000100:00100000:1.0:1790919087.823345:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2353:x1877914532468480:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:1.0:1790919087.823425:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2353:x1877914532468480:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 80us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919087.823433:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 104 00000100:00100000:1.0:1790919087.823452:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 105 00000100:00100000:1.0:1790919087.823458:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5591729f-44f1-43f1-b042-c3a508737d97+5:2353:x1877914532468736:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:1.0:1790919087.823485:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5591729f-44f1-43f1-b042-c3a508737d97+5:2353:x1877914532468736:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 26us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919087.823491:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 105 00000100:00100000:3.0:1790919087.823553:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532468608 00000100:00100000:3.0:1790919087.823557:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532468608 00000100:00100000:3.0:1790919087.823589:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 58 00000100:00100000:3.0:1790919087.823595:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2353:x1877914532468608:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1790919087.823624:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2353:x1877914532468608:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 30us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919087.823630:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 58 00000100:00100000:0.0:1790919087.823885:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532468352 00000100:00100000:0.0:1790919087.823900:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532468352 00000100:00100000:0.0:1790919087.823936:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 250 00000100:00100000:0.0:1790919087.823944:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be86bb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+11:2353:x1877914532468352:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:0.0:1790919087.823990:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be86bb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+11:2353:x1877914532468352:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 47us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919087.823997:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 250 00000100:00080000:0.0:1790919087.824028:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790919087.824032:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790919088.143346:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919088.143424:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532468864 00000100:00100000:3.0:1790919088.143434:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532468864 00000100:00100000:3.0:1790919088.143492:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 251 00000100:00100000:3.0:1790919088.143502:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be86bb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+11:5591:x1877914532468864:12345-192.168.201.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790919088.143519:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919088.143568:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be81517000/0xc3296956897c4490 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8b413717672cbbf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919088.143615:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be81517000/0xc3296956897c4490 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cbbf expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919088.143638:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be81517000/0xc3296956897c4490 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cbbf expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919088.143648:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81517000, rc 0) 00000100:00100000:3.0:1790919088.143705:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be86bb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+12:5591:x1877914532468864:12345-192.168.201.27@tcp:101:ll_cfg_requeue.0 Request processed in 205us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919088.143712:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 251 00000100:00100000:3.0:1790919088.156177:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919088.156320:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532468992 00000100:00100000:1.0:1790919088.156330:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532468992 00000100:00100000:1.0:1790919088.156380:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 252 00000100:00100000:1.0:1790919088.156389:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be86bbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+12:5591:x1877914532468992:12345-192.168.201.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790919088.156685:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be86bbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+12:5591:x1877914532468992:12345-192.168.201.27@tcp:501:ll_cfg_requeue.0 Request processed in 296us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919088.156693:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 252 00000100:00100000:1.0:1790919088.160792:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919088.160902:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532469120 00000100:00100000:0.0:1790919088.160912:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532469120 00000100:00100000:0.0:1790919088.160987:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 253 00000100:00100000:0.0:1790919088.160998:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be86bbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+12:5591:x1877914532469120:12345-192.168.201.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790919088.161208:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be86bbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+12:5591:x1877914532469120:12345-192.168.201.27@tcp:503:ll_cfg_requeue.0 Request processed in 211us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919088.161217:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 253 00000100:00100000:2.0:1790919088.183671:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919088.183819:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532469248 00000100:00100000:3.0:1790919088.183830:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532469248 00000100:00100000:3.0:1790919088.183953:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 254 00000100:00100000:3.0:1790919088.183965:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be86bba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+12:9932:x1877914532469248:12345-192.168.201.27@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790919088.184255:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be86bba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+12:9932:x1877914532469248:12345-192.168.201.27@tcp:502:llog_process_th.0 Request processed in 291us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919088.184264:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 254 00000100:00100000:3.0:1790919088.192021:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919088.192495:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532469376 00000100:00100000:1.0:1790919088.192896:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532469376 00000100:00100000:1.0:1790919088.193071:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 255 00000100:00100000:1.0:1790919088.193082:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be86bb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+12:9932:x1877914532469376:12345-192.168.201.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790919088.193348:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be86bb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+12:9932:x1877914532469376:12345-192.168.201.27@tcp:502:llog_process_th.0 Request processed in 267us (1335us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919088.193356:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 255 00000100:00100000:1.0:1790919088.223387:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919088.223502:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532469504 00000100:00100000:3.0:1790919088.223691:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532469504 00000100:00100000:3.0:1790919088.223780:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 256 00000100:00100000:3.0:1790919088.223790:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88d03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+12:5591:x1877914532469504:12345-192.168.201.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790919088.223807:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919088.223825:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be81516e00/0xc3296956897c4497 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8b413717672cbc6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919088.223878:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be81516e00/0xc3296956897c4497 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cbc6 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919088.223920:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be81516e00/0xc3296956897c4497 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cbc6 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919088.223929:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81516e00, rc 0) 00000100:00100000:3.0:1790919088.224200:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88d03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+13:5591:x1877914532469504:12345-192.168.201.27@tcp:101:ll_cfg_requeue.0 Request processed in 255us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919088.224210:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 256 00000100:00100000:2.0:1790919088.227620:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919088.227788:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532469632 00000100:00100000:1.0:1790919088.227801:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532469632 00000100:00100000:1.0:1790919088.227967:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 257 00000100:00100000:1.0:1790919088.227979:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88d03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+13:5591:x1877914532469632:12345-192.168.201.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790919088.231609:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88d03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+13:5591:x1877914532469632:12345-192.168.201.27@tcp:501:ll_cfg_requeue.0 Request processed in 3625us (3991us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919088.231622:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 257 00000100:00100000:2.0:1790919088.233796:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919088.233868:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532469760 00000100:00100000:3.0:1790919088.233877:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532469760 00000100:00100000:3.0:1790919088.233942:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 258 00000100:00100000:3.0:1790919088.233951:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88d02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+13:5591:x1877914532469760:12345-192.168.201.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790919088.234201:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88d02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+13:5591:x1877914532469760:12345-192.168.201.27@tcp:503:ll_cfg_requeue.0 Request processed in 250us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919088.234209:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 258 00000100:00100000:2.0:1790919088.239094:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919088.239281:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532469888 00000100:00100000:1.0:1790919088.239305:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532469888 00000100:00100000:1.0:1790919088.239357:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 259 00000100:00100000:1.0:1790919088.239367:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88d01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+13:9935:x1877914532469888:12345-192.168.201.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790919088.239645:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88d01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+13:9935:x1877914532469888:12345-192.168.201.27@tcp:502:llog_process_th.0 Request processed in 279us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919088.239654:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 259 00000100:00100000:2.0:1790919088.246954:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919088.247154:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532470016 00000100:00100000:0.0:1790919088.247174:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532470016 00000100:00100000:0.0:1790919088.247243:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 260 00000100:00100000:0.0:1790919088.247253:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+13:9935:x1877914532470016:12345-192.168.201.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790919088.247516:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+13:9935:x1877914532470016:12345-192.168.201.27@tcp:502:llog_process_th.0 Request processed in 256us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919088.247553:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 260 10000000:01000000:2.0:1790919088.255724:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790919088.255732:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88bebf8da800 from 7 10000000:01000000:2.0:1790919088.255738:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790919088.255786:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be88386a00/0xc3296956897c449e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919088.255798:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88be88386a00/0xc3296956897c449e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919088.255810:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88be88386a00/0xc3296956897c449e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919088.255834:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf6e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550327936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790919088.255967:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919088.256148:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beadae5e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790919088.262700:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550327936 00000100:00100000:3.0:1790919088.262717:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550327936 00000100:00100000:3.0:1790919088.263314:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1790919088.263326:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+16:5842:x1877914550327936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790919088.263345:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919088.263363:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be81516c00/0xc3296956897c44a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c449e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919088.263389:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be81516c00/0xc3296956897c44a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c449e expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919088.263413:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be81516c00/0xc3296956897c44a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c449e expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919088.263422:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81516c00, rc 0) 00000100:00100000:3.0:1790919088.263499:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:5842:x1877914550327936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (7532us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919088.263505:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1790919088.263804:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf6e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550327936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790919088.263823:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88be88386a00/0xc3296956897c449e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c44a5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919088.263832:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88be88386a00/0xc3296956897c449e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c44a5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919088.263920:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf6e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550328064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790919088.263957:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919088.264276:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beadae5e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790919088.264424:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550328064 00000100:00100000:3.0:1790919088.264429:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550328064 00000100:00100000:3.0:1790919088.264448:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1790919088.264453:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:5842:x1877914550328064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790919088.264708:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:5842:x1877914550328064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 254us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919088.264716:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1790919088.264787:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf6e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550328064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790919088.264817:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf6e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550328192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790919088.264861:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919088.264892:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beadae5e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790919088.264990:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550328192 00000100:00100000:3.0:1790919088.265003:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550328192 00000100:00100000:3.0:1790919088.265024:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1790919088.265030:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:5842:x1877914550328192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790919088.265196:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:5842:x1877914550328192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919088.265204:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1790919088.265568:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf6e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550328192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790919088.266259:0:11704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf6e1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:11704:1877914550328320:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790919088.266310:0:11704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919088.266336:0:11704:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beadae5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790919088.266481:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550328320 00000100:00100000:3.0:1790919088.266486:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550328320 00000100:00100000:3.0:1790919088.266522:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1790919088.266559:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:11704:x1877914550328320:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790919088.266733:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:11704:x1877914550328320:12345-0@lo:502:llog_process_th.0 Request processed in 176us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919088.266741:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1790919088.266896:0:11704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf6e1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:11704:1877914550328320:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790919088.266920:0:11704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790919088.266930:0:11704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919088.266932:0:11704:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790919088.266938:0:11704:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff88bebf8da800 00000020:00000080:2.0:1790919088.266941:0:11704:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1790919088.267025:0:11704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf6e1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:11704:1877914550328448:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790919088.267074:0:11704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919088.267092:0:11704:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be880243c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919088.268391:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550328448 00000100:00100000:0.0:1790919088.268400:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550328448 00000100:00100000:0.0:1790919088.268444:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1790919088.268454:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:11704:x1877914550328448:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790919088.268694:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:11704:x1877914550328448:12345-0@lo:502:llog_process_th.0 Request processed in 242us (1619us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919088.268702:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1790919088.270230:0:11704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf6e1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:11704:1877914550328448:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790919088.270265:0:11704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790919088.270273:0:11704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919088.270275:0:11704:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1790919088.270279:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1790919088.271957:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1790919088.271982:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790919088.271995:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be88386a00/0xc3296956897c449e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c44a5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919088.272009:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88be88386a00/0xc3296956897c449e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c44a5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919088.272019:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790919088.272022:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88be86b70000 from 7 10000000:01000000:3.0:1790919088.272025:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790919088.272060:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be81517200/0xc3296956897c44ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919088.272069:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88be81517200/0xc3296956897c44ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919088.272079:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88be81517200/0xc3296956897c44ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919088.272103:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb413bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550328576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790919088.273012:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919088.273104:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be838f8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790919088.274006:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550328576 00000100:00100000:1.0:1790919088.274017:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550328576 00000100:00100000:0.0:1790919088.275747:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1790919088.275764:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:5842:x1877914550328576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790919088.275780:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919088.275798:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88bebac58800/0xc3296956897c44b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c44ac expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919088.275825:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88bebac58800/0xc3296956897c44b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c44ac expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919088.275842:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88bebac58800/0xc3296956897c44b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c44ac expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919088.275862:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac58800, rc 0) 00000100:00100000:0.0:1790919088.275942:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:5842:x1877914550328576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (2933us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919088.275949:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1790919088.276058:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb413bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550328576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790919088.276076:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88be81517200/0xc3296956897c44ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c44b3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919088.276090:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88be81517200/0xc3296956897c44ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c44b3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919088.276166:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb413bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550328704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790919088.276201:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919088.276234:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be838f8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790919088.277216:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550328704 00000100:00100000:0.0:1790919088.277226:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550328704 00000100:00100000:0.0:1790919088.277281:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1790919088.277290:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:5842:x1877914550328704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790919088.277815:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:5842:x1877914550328704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 525us (1611us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919088.277824:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1790919088.277968:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb413bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550328704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790919088.278018:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac5c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550328832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790919088.278064:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919088.278090:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be903ffa80 going to sleep for 11 seconds 00000100:00100000:0.0:1790919088.278104:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550328832 00000100:00100000:0.0:1790919088.278108:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550328832 00000100:00100000:0.0:1790919088.278127:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1790919088.278133:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:5842:x1877914550328832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790919088.278292:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:5842:x1877914550328832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919088.279289:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1790919088.279661:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac5c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550328832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790919088.293950:0:11707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf6e1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:11707:1877914550328960:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790919088.294038:0:11707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919088.294085:0:11707:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be88024e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790919088.294105:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550328960 00000100:00100000:3.0:1790919088.294113:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550328960 00000100:00100000:3.0:1790919088.294158:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1790919088.294168:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:11707:x1877914550328960:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790919088.294543:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:11707:x1877914550328960:12345-0@lo:502:llog_process_th.0 Request processed in 360us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919088.294551:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1790919088.294578:0:11707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf6e1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:11707:1877914550328960:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790919088.294605:0:11707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790919088.294614:0:11707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919088.294616:0:11707:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790919088.294623:0:11707:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff88be86b70000 00000020:00000080:2.0:1790919088.294626:0:11707:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1790919088.294698:0:11707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf6e1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:11707:1877914550329088:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790919088.294730:0:11707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919088.294747:0:11707:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be88024e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790919088.295872:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550329088 00000100:00100000:0.0:1790919088.295892:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550329088 00000100:00100000:0.0:1790919088.296049:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1790919088.296059:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:11707:x1877914550329088:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790919088.296278:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:11707:x1877914550329088:12345-0@lo:502:llog_process_th.0 Request processed in 220us (1546us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919088.296286:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1790919088.299657:0:11707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf6e1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:11707:1877914550329088:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790919088.299711:0:11707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790919088.299723:0:11707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919088.299726:0:11707:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1790919088.299730:0:11707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000040:00080000:1.0:1790919088.301808:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000000:1.0:1790919088.305724:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1790919088.305760:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790919088.305772:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be81517200/0xc3296956897c44ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c44b3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919088.305785:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88be81517200/0xc3296956897c44ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c44b3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919088.305797:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790919088.305800:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88be91614800 from 7 10000000:01000000:1.0:1790919088.305802:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790919088.305844:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88beb3f7fa00/0xc3296956897c44ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919088.305851:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88beb3f7fa00/0xc3296956897c44ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919088.305877:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88beb3f7fa00/0xc3296956897c44ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919088.306445:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac90380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550329216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790919088.307624:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919088.307668:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550329216 00000100:00100000:1.0:1790919088.307672:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb3f48840 going to sleep for 11 seconds 00000100:00100000:3.0:1790919088.307686:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550329216 00000100:00100000:3.0:1790919088.307728:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1790919088.307737:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:5842:x1877914550329216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790919088.307751:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919088.307766:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be81516800/0xc3296956897c44c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c44ba expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919088.307791:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be81516800/0xc3296956897c44c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c44ba expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919088.307802:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be81516800/0xc3296956897c44c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c44ba expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919088.307822:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81516800, rc 0) 00000100:00100000:3.0:1790919088.307899:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:5842:x1877914550329216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919088.307905:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1790919088.308085:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac90380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550329216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790919088.308103:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88beb3f7fa00/0xc3296956897c44ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c44c1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919088.308112:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88beb3f7fa00/0xc3296956897c44ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c44c1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919088.308175:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac90380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550329344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790919088.308203:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919088.308228:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb3f48840 going to sleep for 11 seconds 00000100:00100000:3.0:1790919088.308381:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550329344 00000100:00100000:3.0:1790919088.308386:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550329344 00000100:00100000:3.0:1790919088.308417:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1790919088.308424:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:5842:x1877914550329344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790919088.308792:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:5842:x1877914550329344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 367us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919088.308799:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1790919088.308939:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac90380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550329344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790919088.308982:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac90380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550329472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790919088.309022:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919088.309050:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb3f48840 going to sleep for 11 seconds 00000100:00100000:3.0:1790919088.309055:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550329472 00000100:00100000:3.0:1790919088.309059:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550329472 00000100:00100000:3.0:1790919088.309093:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1790919088.309100:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:5842:x1877914550329472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790919088.309247:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:5842:x1877914550329472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 147us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919088.309254:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1790919088.309292:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac90380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:5842:1877914550329472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790919088.309703:0:11709:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac90380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:11709:1877914550329600:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790919088.309814:0:11709:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919088.309841:0:11709:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb3f48d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790919088.309936:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550329600 00000100:00100000:3.0:1790919088.309941:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550329600 00000100:00100000:3.0:1790919088.309982:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1790919088.309990:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:11709:x1877914550329600:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790919088.310123:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:11709:x1877914550329600:12345-0@lo:502:llog_process_th.0 Request processed in 134us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919088.310130:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1790919088.310145:0:11709:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac90380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:11709:1877914550329600:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790919088.310167:0:11709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790919088.310175:0:11709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919088.310178:0:11709:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790919088.310185:0:11709:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff88be91614800 00000020:00000080:1.0:1790919088.310187:0:11709:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790919088.310310:0:11709:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac90380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:11709:1877914550329728:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790919088.310346:0:11709:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919088.310370:0:11709:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb3f48d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790919088.310463:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550329728 00000100:00100000:2.0:1790919088.310467:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550329728 00000100:00100000:2.0:1790919088.310498:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1790919088.310504:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:11709:x1877914550329728:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790919088.310642:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:11709:x1877914550329728:12345-0@lo:502:llog_process_th.0 Request processed in 137us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919088.310649:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1790919088.310738:0:11709:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac90380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:11709:1877914550329728:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790919088.310756:0:11709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790919088.310763:0:11709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919088.310765:0:11709:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1790919088.310768:0:11709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1790919088.310908:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1790919088.310933:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790919088.310943:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88beb3f7fa00/0xc3296956897c44ba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c44c1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919088.310954:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88beb3f7fa00/0xc3296956897c44ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c44c1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919088.383892:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790919089.344606:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790919089.409161:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3308:1877914550329856:0@lo:400:kworker.0 00000100:00100000:1.0:1790919089.409194:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1877914550330112:0@lo:400:kworker.0 00000100:00100000:1.0:1790919089.409253:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919089.409256:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919089.409327:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550330240:0@lo:400:kworker.0 00000100:00100000:0.0:1790919089.409442:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877914550329984:0@lo:400:kworker.0 00000100:00100000:2.0:1790919089.412191:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1877914550330368:0@lo:400:kworker.0 00000100:00100000:2.0:1790919089.412253:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919089.412329:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550329856 00000100:00100000:2.0:1790919089.412336:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550329856 00000100:00100000:2.0:1790919089.412513:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1790919089.412523:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3308:x1877914550329856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919089.412599:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3308:x1877914550329856:12345-0@lo:400:kworker.0 Request processed in 76us (3348us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919089.412608:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1790919089.412665:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3308:1877914550329856:0@lo:400:kworker.0 00000100:00100000:2.0:1790919089.412699:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550330112 00000100:00100000:2.0:1790919089.412703:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550330112 00000100:00100000:2.0:1790919089.412744:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550330368 00000100:00100000:2.0:1790919089.412748:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550330368 00000100:00100000:2.0:1790919089.412766:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1790919089.412772:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877914550330112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919089.412808:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877914550330112:12345-0@lo:400:kworker.0 Request processed in 36us (3562us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919089.412829:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1790919089.412841:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1790919089.412846:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877914550330368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919089.413101:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877914550330368:12345-0@lo:400:kworker.0 Request processed in 193us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919089.413108:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1790919089.413144:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1877914550330368:0@lo:400:kworker.0 00000100:00080000:2.0:1790919089.413169:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790919089.416655:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1877914550330112:0@lo:400:kworker.0 00000100:00100000:3.0:1790919089.420757:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919089.421245:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919089.421287:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550330496:0@lo:400:kworker.0 00000100:00100000:3.0:1790919089.421331:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550329984 00000100:00100000:0.0:1790919089.421332:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919089.421341:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550329984 00000100:00100000:0.0:1790919089.421361:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550330240 00000100:00100000:0.0:1790919089.421367:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550330240 00000100:00100000:3.0:1790919089.421392:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1790919089.421403:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877914550329984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919089.421410:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550330496 00000100:00100000:0.0:1790919089.421415:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550330496 00000100:00100000:0.0:1790919089.421439:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790919089.421448:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb413ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550330240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919089.421465:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877914550329984:12345-0@lo:400:kworker.0 Request processed in 63us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919089.421472:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1790919089.421498:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb413ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550330240:12345-0@lo:400:kworker.0 Request processed in 51us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919089.421504:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790919089.421592:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877914550329984:0@lo:400:kworker.0 00000100:00100000:3.0:1790919089.421672:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550330496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919089.421708:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550330496:12345-0@lo:400:kworker.0 Request processed in 197us (377us total) trans 0 rc 0/0 00010000:00080000:1.0:1790919089.421756:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebac92d80 x1877914550330496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919089.421766:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550330496:0@lo:400:kworker.0 00010000:00010000:2.0:1790919089.422363:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790919089.422390:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790919089.422395:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790919089.422430:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1790919089.422437:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88beb3b39880, transno 4294967300 00000100:00100000:2.0:1790919089.422474:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550330240:0@lo:400:kworker.0 00000100:00100000:0.0:1790919089.433021:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790919089.436720:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790919089.921900:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790919089.921928:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550330624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790919089.922006:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919089.922309:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550330624 00000100:00100000:1.0:1790919089.922319:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550330624 00000100:00100000:1.0:1790919089.922379:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790919089.922416:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4138a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550330624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790919089.922454:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919089.922511:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4138a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550330624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919089.922518:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1790919089.922838:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebac92d80 x1877914550330624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919105 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919089.922888:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550330624:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790919090.431782:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919091.461665:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919091.971801:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790919091.971836:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550330752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790919091.971908:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919091.973619:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550330752 00000100:00100000:1.0:1790919091.973634:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550330752 00000100:00100000:1.0:1790919091.973723:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790919091.973735:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4139f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550330752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790919091.973773:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919091.973854:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4139f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550330752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (1944us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919091.973861:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1790919091.974326:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790919091.974764:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550330752:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790919092.479874:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919092.944433:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919092.944477:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919092.944511:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919092.944583:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919092.944730:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532470272 00000100:00100000:3.0:1790919092.944739:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532470272 00000100:00100000:3.0:1790919092.944809:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532470528 00000100:00100000:3.0:1790919092.944812:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532470528 00000100:00100000:3.0:1790919092.944837:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 109 00000100:00100000:3.0:1790919092.944846:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2350:x1877914532470272:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1790919092.944943:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2350:x1877914532470272:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 96us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919092.944951:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 109 00000100:00100000:3.0:1790919092.944968:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 110 00000100:00100000:3.0:1790919092.944973:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5591729f-44f1-43f1-b042-c3a508737d97+5:2350:x1877914532470528:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1790919092.945008:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5591729f-44f1-43f1-b042-c3a508737d97+5:2350:x1877914532470528:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 35us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919092.945014:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 110 00000100:00100000:1.0:1790919092.945202:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532470144 00000100:00100000:1.0:1790919092.945207:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532470144 00000100:00100000:1.0:1790919092.945246:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 277 00000100:00100000:1.0:1790919092.945253:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+13:2350:x1877914532470144:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:1.0:1790919092.945280:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+13:2350:x1877914532470144:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 28us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919092.945287:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 277 00000100:00100000:0.0:1790919092.945515:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532470400 00000100:00100000:0.0:1790919092.945549:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532470400 00000100:00100000:0.0:1790919092.945591:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 61 00000100:00100000:0.0:1790919092.945598:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2350:x1877914532470400:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:0.0:1790919092.945626:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2350:x1877914532470400:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 29us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919092.945633:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 61 00000100:00080000:2.0:1790919092.945899:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790919092.945904:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790919093.503958:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919094.527795:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550331264:0@lo:400:kworker.0 00000100:00100000:1.0:1790919094.527870:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919094.527920:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877914550331008:0@lo:400:kworker.0 00000100:00100000:1.0:1790919094.527926:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790919094.527931:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3307:1877914550330880:0@lo:400:kworker.0 00000100:00100000:1.0:1790919094.527955:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919094.527979:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919094.527987:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1877914550331392:0@lo:400:kworker.0 00000100:00100000:0.0:1790919094.527999:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550331520:0@lo:400:kworker.0 00000100:00100000:1.0:1790919094.528007:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919094.528018:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919094.528031:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1877914550331136:0@lo:400:kworker.0 00000100:00100000:0.0:1790919094.528047:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550331264 00000100:00100000:1.0:1790919094.528053:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919094.528054:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550331264 00000100:00100000:1.0:1790919094.528079:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550331008 00000100:00100000:1.0:1790919094.528082:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550331008 00000100:00100000:0.0:1790919094.528102:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550331520 00000100:00100000:1.0:1790919094.528104:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550331392 00000100:00100000:0.0:1790919094.528105:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550331520 00000100:00100000:1.0:1790919094.528106:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550331392 00000100:00100000:1.0:1790919094.528117:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550331136 00000100:00100000:1.0:1790919094.528119:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550331136 00000100:00100000:0.0:1790919094.528125:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790919094.528132:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1790919094.528132:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550331264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919094.528137:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877914550331008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919094.528184:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877914550331008:12345-0@lo:400:kworker.0 Request processed in 45us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919094.528184:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550331264:12345-0@lo:400:kworker.0 Request processed in 51us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919094.528191:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1790919094.528191:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790919094.528208:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1790919094.528208:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790919094.528214:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877914550331392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919094.528214:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550331520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919094.528239:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877914550331392:12345-0@lo:400:kworker.0 Request processed in 26us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919094.528239:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550331520:12345-0@lo:400:kworker.0 Request processed in 26us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919094.528245:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790919094.528246:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1790919094.528256:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00010000:00010000:0.0:1790919094.528261:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919094.528262:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877914550331136:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1790919094.528273:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790919094.528283:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790919094.528285:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790919094.528289:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877914550331136:12345-0@lo:400:kworker.0 Request processed in 27us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919094.528294:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1790919094.528315:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1877914550331136:0@lo:400:kworker.0 00000100:00100000:0.0:1790919094.528315:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877914550331008:0@lo:400:kworker.0 00010000:00080000:0.0:1790919094.528327:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebac92a00 x1877914550331520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919094.528336:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550331520:0@lo:400:kworker.0 00000100:00100000:0.0:1790919094.528355:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1877914550331392:0@lo:400:kworker.0 00000100:00100000:0.0:1790919094.528363:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550331264:0@lo:400:kworker.0 00000100:00100000:2.0:1790919094.528437:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550330880 00000100:00100000:2.0:1790919094.528442:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550330880 00000100:00100000:2.0:1790919094.528475:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1790919094.528491:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3307:x1877914550330880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919094.528561:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3307:x1877914550330880:12345-0@lo:400:kworker.0 Request processed in 71us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919094.528567:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1790919094.529061:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3307:1877914550330880:0@lo:400:kworker.0 00000100:00100000:0.0:1790919095.039851:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790919095.039877:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550331648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790919095.039949:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919095.040160:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550331648 00000100:00100000:1.0:1790919095.040169:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550331648 00000100:00100000:1.0:1790919095.040225:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790919095.040235:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550331648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790919095.040275:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919095.040334:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550331648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919095.040342:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1790919095.040423:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebac93480 x1877914550331648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919111 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919095.040441:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550331648:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790919095.552082:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919096.575943:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919097.087942:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790919097.087965:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550331776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790919097.088036:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919097.088211:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550331776 00000100:00100000:1.0:1790919097.088219:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550331776 00000100:00100000:1.0:1790919097.088284:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790919097.088293:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550331776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790919097.088327:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919097.088376:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550331776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919097.088383:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1790919097.088483:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790919097.088520:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550331776:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790919097.601753:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919098.068654:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919098.068694:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919098.068738:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919098.068770:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919098.068885:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532470912 00000100:00100000:0.0:1790919098.068895:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532470912 00000100:00100000:0.0:1790919098.068965:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 64 00000100:00100000:0.0:1790919098.068974:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2353:x1877914532470912:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:0.0:1790919098.069048:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2353:x1877914532470912:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 76us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919098.069056:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 64 00000100:00100000:3.0:1790919098.069377:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532470656 00000100:00100000:3.0:1790919098.069382:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532470656 00000100:00100000:3.0:1790919098.069420:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 279 00000100:00100000:3.0:1790919098.069427:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+13:2353:x1877914532470656:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1790919098.069475:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+13:2353:x1877914532470656:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 49us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919098.069481:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 279 00000100:00100000:1.0:1790919098.069788:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532470784 00000100:00100000:1.0:1790919098.069794:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532470784 00000100:00100000:1.0:1790919098.069824:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532471040 00000100:00100000:1.0:1790919098.069827:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532471040 00000100:00100000:1.0:1790919098.069847:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 114 00000100:00100000:1.0:1790919098.069854:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebfbf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2353:x1877914532470784:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:1.0:1790919098.069890:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebfbf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2353:x1877914532470784:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 37us (1152us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919098.069897:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 114 00000100:00100000:1.0:1790919098.069911:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 115 00000100:00100000:1.0:1790919098.069931:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebfbf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5591729f-44f1-43f1-b042-c3a508737d97+5:2353:x1877914532471040:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:1.0:1790919098.069957:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebfbf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5591729f-44f1-43f1-b042-c3a508737d97+5:2353:x1877914532471040:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 27us (1186us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919098.069962:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 115 00000100:00080000:2.0:1790919098.070366:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790919098.070372:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790919098.625554:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790919099.584357:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790919099.652081:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550332288:0@lo:400:kworker.0 00000100:00100000:1.0:1790919099.652158:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919099.652225:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790919099.652233:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3307:1877914550331904:0@lo:400:kworker.0 00000100:00100000:1.0:1790919099.652260:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919099.652285:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1877914550332416:0@lo:400:kworker.0 00000100:00100000:1.0:1790919099.652308:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919099.652339:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550331904 00000100:00100000:1.0:1790919099.652346:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550331904 00000100:00100000:1.0:1790919099.652391:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1790919099.652399:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3307:x1877914550331904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919099.652448:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3307:x1877914550331904:12345-0@lo:400:kworker.0 Request processed in 49us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919099.652455:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1790919099.652502:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3307:1877914550331904:0@lo:400:kworker.0 00000100:00100000:1.0:1790919099.652544:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550332416 00000100:00100000:1.0:1790919099.652547:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550332416 00000100:00100000:1.0:1790919099.652580:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1790919099.652586:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877914550332416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919099.652621:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877914550332416:12345-0@lo:400:kworker.0 Request processed in 36us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919099.652643:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1790919099.652670:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1877914550332416:0@lo:400:kworker.0 00000100:00080000:1.0:1790919099.652700:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790919099.652770:0:10350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550332288 00000100:00100000:0.0:1790919099.652774:0:10350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550332288 00000100:00100000:0.0:1790919099.652816:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790919099.652824:0:10350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550332288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919099.652884:0:10350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550332288:12345-0@lo:400:kworker.0 Request processed in 61us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919099.652891:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790919099.653044:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877914550332032:0@lo:400:kworker.0 00000100:00100000:2.0:1790919099.653076:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919099.653093:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550332544:0@lo:400:kworker.0 00000100:00100000:2.0:1790919099.653114:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919099.653134:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790919099.653140:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1877914550332160:0@lo:400:kworker.0 00000100:00100000:2.0:1790919099.653170:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919099.653204:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550332544 00000100:00100000:2.0:1790919099.653208:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550332544 00000100:00100000:2.0:1790919099.653235:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790919099.653242:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550332544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919099.653277:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550332544:12345-0@lo:400:kworker.0 Request processed in 35us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919099.653283:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:2.0:1790919099.653309:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebac3f100 x1877914550332544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919099.653318:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550332544:0@lo:400:kworker.0 00010000:00010000:3.0:1790919099.653572:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919099.653622:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550332032 00000100:00100000:0.0:1790919099.653627:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550332032 00000100:00100000:0.0:1790919099.653658:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550332160 00000100:00100000:0.0:1790919099.653662:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550332160 00000100:00100000:0.0:1790919099.653700:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1790919099.653707:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebacb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877914550332032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919099.653743:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebacb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877914550332032:12345-0@lo:400:kworker.0 Request processed in 37us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919099.653748:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1790919099.653759:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1790919099.653764:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877914550332160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919099.653789:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877914550332160:12345-0@lo:400:kworker.0 Request processed in 24us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919099.653793:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1790919099.654216:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550332288:0@lo:400:kworker.0 00000100:00080000:1.0:1790919099.654237:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790919099.654241:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790919099.654243:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790919099.654308:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1877914550332160:0@lo:400:kworker.0 00000100:00100000:2.0:1790919099.654318:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877914550332032:0@lo:400:kworker.0 00000100:00100000:2.0:1790919100.159780:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550332672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790919100.159851:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919100.160072:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550332672 00000100:00100000:1.0:1790919100.160081:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550332672 00000100:00100000:1.0:1790919100.160132:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790919100.160141:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550332672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790919100.160176:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919100.160241:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550332672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919100.160248:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1790919100.160394:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebac91c00 x1877914550332672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919116 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919100.160412:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550332672:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790919100.672950:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919101.699117:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919102.208002:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550332800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790919102.208077:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919102.208251:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550332800 00000100:00100000:0.0:1790919102.208260:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550332800 00000100:00100000:0.0:1790919102.208325:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790919102.208331:0:6701:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1790919102.208334:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb413b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550332800:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790919102.208339:0:6701:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:0.0:1790919102.208381:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790919102.208435:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb413b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550332800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919102.208442:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1790919102.208619:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790919102.208758:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550332800:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790919102.719735:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919103.200035:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919103.200089:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919103.200149:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919103.200193:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919103.200217:0:10350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532471424 00000100:00100000:0.0:1790919103.200226:0:10350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532471424 00000100:00100000:0.0:1790919103.200285:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 19 00000100:00100000:0.0:1790919103.200294:0:10350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2349:x1877914532471424:12345-192.168.201.27@tcp:9:kworker.0 00000020:00000080:0.0:1790919103.200326:0:10350:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3296956897c43fd 00000100:00080000:0.0:1790919103.200335:0:10350:0:(import.c:65:import_set_state_nolock()) ffff88beb9f1a800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790919103.200368:0:10350:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1790919103.200698:0:10350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+2:2349:x1877914532471424:12345-192.168.201.27@tcp:9:kworker.0 Request processed in 403us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919103.200707:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 19 00000100:00080000:0.0:1790919103.200729:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790919103.200952:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919103.201352:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532471168 00000100:00100000:2.0:1790919103.201360:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532471168 00000100:00100000:2.0:1790919103.201417:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 281 00000100:00100000:2.0:1790919103.201438:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+13:2353:x1877914532471168:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:2.0:1790919103.201477:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+13:2353:x1877914532471168:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 42us (1452us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919103.201483:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 281 00000100:00100000:3.0:1790919103.202256:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532471296 00000100:00100000:3.0:1790919103.202266:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532471296 00000100:00100000:3.0:1790919103.202367:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532471552 00000100:00100000:3.0:1790919103.202371:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532471552 00000100:00080000:0.0:1790919103.202435:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790919103.213233:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 119 00000100:00100000:1.0:1790919103.213255:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2353:x1877914532471296:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:1.0:1790919103.213364:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2353:x1877914532471296:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 110us (13265us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919103.213372:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 119 00000100:00100000:1.0:1790919103.213581:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 120 00000100:00100000:1.0:1790919103.213590:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5591729f-44f1-43f1-b042-c3a508737d97+5:2352:x1877914532471552:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:1.0:1790919103.213650:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5591729f-44f1-43f1-b042-c3a508737d97+5:2352:x1877914532471552:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 61us (13456us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919103.213656:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 120 00010000:00010000:2.0:1790919103.743834:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919104.767824:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919104.768097:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877914550333056:0@lo:400:kworker.0 00000100:00100000:1.0:1790919104.768166:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919104.768258:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790919104.768285:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3307:1877914550332928:0@lo:400:kworker.0 00000100:00100000:3.0:1790919104.768318:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919104.768371:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550333056 00000100:00100000:3.0:1790919104.768379:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550333056 00000100:00100000:3.0:1790919104.768426:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1790919104.768435:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877914550333056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919104.768543:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550332928 00000100:00100000:0.0:1790919104.768548:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550332928 00000100:00100000:0.0:1790919104.768578:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1790919104.768585:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3307:x1877914550332928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919104.768636:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3307:x1877914550332928:12345-0@lo:400:kworker.0 Request processed in 51us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919104.768643:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1790919104.768692:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3307:1877914550332928:0@lo:400:kworker.0 00000100:00100000:0.0:1790919104.768877:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1877914550333184:0@lo:400:kworker.0 00000100:00100000:0.0:1790919104.768907:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919104.768957:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550333184 00000100:00100000:0.0:1790919104.768961:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550333184 00000100:00100000:0.0:1790919104.768991:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1790919104.769007:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877914550333184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919104.769044:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877914550333184:12345-0@lo:400:kworker.0 Request processed in 38us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919104.769049:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:0.0:1790919104.769066:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790919104.769088:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1877914550333184:0@lo:400:kworker.0 00000100:00100000:3.0:1790919104.769872:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877914550333056:12345-0@lo:400:kworker.0 Request processed in 1436us (1704us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919104.769880:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1790919104.771565:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790919104.771698:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1877914550333440:0@lo:400:kworker.0 00000100:00100000:3.0:1790919104.771762:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919104.771794:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790919104.771800:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550333312:0@lo:400:kworker.0 00000100:00100000:3.0:1790919104.771825:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919104.771855:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550333312 00000100:00100000:3.0:1790919104.771863:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550333312 00000100:00100000:3.0:1790919104.771936:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790919104.771944:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb413b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550333312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919104.771993:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb413b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550333312:12345-0@lo:400:kworker.0 Request processed in 49us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919104.772000:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1790919104.772020:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790919104.772046:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550333312:0@lo:400:kworker.0 00000100:00100000:3.0:1790919104.772067:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550333440 00000100:00100000:3.0:1790919104.772070:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550333440 00000100:00080000:3.0:1790919104.772086:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790919104.772107:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1790919104.772128:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4139500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877914550333440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919104.772166:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4139500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877914550333440:12345-0@lo:400:kworker.0 Request processed in 39us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919104.772172:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1790919104.772195:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1877914550333440:0@lo:400:kworker.0 00000100:00100000:2.0:1790919104.772381:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550333568:0@lo:400:kworker.0 00000100:00100000:2.0:1790919104.772413:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919104.772559:0:10350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550333568 00000100:00100000:0.0:1790919104.772564:0:10350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550333568 00000100:00100000:0.0:1790919104.772625:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790919104.772633:0:10350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550333568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919104.772673:0:10350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550333568:12345-0@lo:400:kworker.0 Request processed in 42us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919104.772679:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:2.0:1790919104.772879:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebf74ed80 x1877914550333568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919104.772891:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550333568:0@lo:400:kworker.0 00000100:00080000:3.0:1790919104.773010:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790919104.775763:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877914550333056:0@lo:400:kworker.0 00000100:00100000:2.0:1790919105.280486:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550333696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790919105.280605:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919105.280811:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550333696 00000100:00100000:1.0:1790919105.280821:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550333696 00000100:00100000:1.0:1790919105.280870:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790919105.280880:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550333696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790919105.280918:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919105.280971:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550333696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919105.280978:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:2.0:1790919105.281434:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebac92a00 x1877914550333696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919121 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919105.281452:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550333696:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790919105.792039:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919106.816226:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919107.327969:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790919107.327994:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550333824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790919107.328079:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919107.328308:0:11721:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550333824 00000100:00100000:2.0:1790919107.328318:0:11721:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550333824 00000100:00100000:2.0:1790919107.328384:0:11721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790919107.328395:0:11721:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb413a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550333824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790919107.328429:0:11721:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790919107.328480:0:11721:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb413a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550333824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919107.328486:0:11721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790919107.328581:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550333824:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790919107.328754:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1790919107.462817:0:6722:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c4a4e085-55d7-40e9-993c-11b4dfc2d5f5 00000020:00000080:1.0:1790919107.462828:0:6722:0:(genops.c:885:class_export_put()) final put ffff88beb9f1d000/c4a4e085-55d7-40e9-993c-11b4dfc2d5f5 00000020:00000080:1.0:1790919107.462860:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88beb9f1d000/c4a4e085-55d7-40e9-993c-11b4dfc2d5f5 for lustre-OST0000 00000020:00000080:1.0:1790919107.462905:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88beb9f1a800 for lustre-OST0000 00010000:00010000:3.0:1790919107.844510:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919108.308158:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919108.308318:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919108.308360:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919108.308658:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532471680 00000100:00100000:2.0:1790919108.308679:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532471680 00000100:00100000:1.0:1790919108.308723:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532471808 00000100:00100000:1.0:1790919108.308734:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532471808 00000100:00100000:2.0:1790919108.308758:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 283 00000100:00100000:2.0:1790919108.308773:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+13:2353:x1877914532471680:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:1.0:1790919108.308822:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532471936 00000100:00100000:1.0:1790919108.308828:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532471936 00000100:00100000:1.0:1790919108.308865:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 124 00000100:00100000:2.0:1790919108.308869:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+13:2353:x1877914532471680:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 97us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919108.308881:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4138700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2353:x1877914532471808:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:2.0:1790919108.308888:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 283 00000100:00100000:1.0:1790919108.308991:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4138700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2353:x1877914532471808:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 113us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919108.309000:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 124 00000100:00100000:1.0:1790919108.309022:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 125 00000100:00100000:1.0:1790919108.309032:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4138000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5591729f-44f1-43f1-b042-c3a508737d97+5:2353:x1877914532471936:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:1.0:1790919108.309072:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4138000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5591729f-44f1-43f1-b042-c3a508737d97+5:2353:x1877914532471936:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 43us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919108.309080:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 125 00000100:00080000:1.0:1790919108.309411:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790919108.874261:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790919109.831452:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790919109.888602:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919109.888931:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877914550334080:0@lo:400:kworker.0 00000100:00100000:2.0:1790919109.888997:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919109.889042:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd82802a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550334592:0@lo:400:kworker.0 00000100:00100000:2.0:1790919109.889083:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919109.889116:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790919109.889123:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1877914550334208:0@lo:400:kworker.0 00000100:00100000:1.0:1790919109.889226:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd82803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550334336:0@lo:400:kworker.0 00000100:00100000:1.0:1790919109.889271:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919109.889294:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790919109.889300:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3307:1877914550333952:0@lo:400:kworker.0 00000100:00100000:1.0:1790919109.889328:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919109.889350:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd82803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1877914550334464:0@lo:400:kworker.0 00000100:00100000:1.0:1790919109.889370:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919109.889399:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550334080 00000100:00100000:1.0:1790919109.889407:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550334080 00000100:00100000:1.0:1790919109.889452:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550334464 00000100:00100000:1.0:1790919109.889455:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550334464 00000100:00100000:1.0:1790919109.889486:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1790919109.889496:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd82801c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877914550334080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919109.889584:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd82801c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877914550334080:12345-0@lo:400:kworker.0 Request processed in 88us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919109.889603:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1790919109.889636:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1790919109.889644:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877914550334464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919109.889680:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877914550334464:12345-0@lo:400:kworker.0 Request processed in 38us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919109.889688:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1790919109.889707:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550334592 00000100:00100000:1.0:1790919109.889711:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550334592 00000100:00100000:1.0:1790919109.889736:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550334336 00000100:00100000:1.0:1790919109.889740:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550334336 00000100:00100000:1.0:1790919109.889759:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790919109.889766:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd82803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550334592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919109.889797:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd82803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550334592:12345-0@lo:400:kworker.0 Request processed in 32us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919109.889804:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790919109.889816:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790919109.889822:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550334336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919109.889850:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550334336:12345-0@lo:400:kworker.0 Request processed in 29us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919109.889856:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790919109.889875:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550333952 00000100:00100000:1.0:1790919109.889879:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550333952 00000100:00100000:1.0:1790919109.889903:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1790919109.889909:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3307:x1877914550333952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919109.889939:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3307:x1877914550333952:12345-0@lo:400:kworker.0 Request processed in 30us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919109.889955:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00080000:1.0:1790919109.889991:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790919109.889996:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790919109.889999:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790919109.890037:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3307:1877914550333952:0@lo:400:kworker.0 00000100:00100000:1.0:1790919109.890051:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd82803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1877914550334464:0@lo:400:kworker.0 00000100:00100000:1.0:1790919109.890061:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd82803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550334336:0@lo:400:kworker.0 00000100:00100000:2.0:1790919109.890596:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919109.890641:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877914550334080:0@lo:400:kworker.0 00010000:00080000:2.0:1790919109.890655:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bd82802a00 x1877914550334592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919109.890665:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd82802a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550334592:0@lo:400:kworker.0 00000100:00100000:1.0:1790919109.892297:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550334208 00000100:00100000:1.0:1790919109.892313:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550334208 00000100:00100000:1.0:1790919109.892391:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1790919109.892401:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd82801180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877914550334208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919109.892488:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd82801180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877914550334208:12345-0@lo:400:kworker.0 Request processed in 88us (1890us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919109.892495:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:2.0:1790919109.893090:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790919109.893337:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1877914550334208:0@lo:400:kworker.0 00000100:00100000:3.0:1790919110.401166:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790919110.401190:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550334720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790919110.401273:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919110.401472:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550334720 00000100:00100000:0.0:1790919110.401480:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550334720 00000100:00100000:0.0:1790919110.401562:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790919110.401572:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4139180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550334720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790919110.401607:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790919110.401667:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4139180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550334720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919110.401675:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1790919110.401850:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebac91500 x1877914550334720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919126 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919110.401867:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550334720:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790919110.917979:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790919111.654309:0:11868:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 01:31:50 (1790919110) 00010000:00010000:1.0:1790919111.935776:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919112.447720:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790919112.447743:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd82802a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550334848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790919112.447828:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919112.447899:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550334848 00000100:00100000:2.0:1790919112.447909:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550334848 00000100:00100000:2.0:1790919112.448220:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790919112.448230:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd82803100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550334848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790919112.448265:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790919112.448313:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd82803100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550334848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919112.448322:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790919112.448369:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd82802a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550334848:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790919112.448440:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790919112.960048:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919113.251048:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919113.251239:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532472064 00000100:00100000:1.0:1790919113.251250:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532472064 00000100:00100000:1.0:1790919113.251336:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 32 00000100:00080000:3.0:1790919113.251340:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790919113.251347:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd82802a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:10205:x1877914532472064:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790919113.251368:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919113.251393:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c44c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cbcd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919113.251520:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e000/0xc3296956897c44cf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919113.251565:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e000/0xc3296956897c44cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919113.251579:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e000/0xc3296956897c44cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790919113.251628:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790919113.251632:0:5846:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790919113.251672:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e000/0xc3296956897c44cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919113.251697:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c44c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cbcd expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919113.251717:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e000/0xc3296956897c44cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cbcd expref: 6 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919113.251726:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be8b621200) 00010000:00010000:1.0:1790919113.251729:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790919113.251732:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88beb3f7e000, rc 0) 00000100:00100000:1.0:1790919113.251791:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd82802a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:10205:x1877914532472064:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 447us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919113.251797:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 32 00000100:00100000:2.0:1790919113.265634:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919113.265701:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532472192 00000100:00100000:1.0:1790919113.265714:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532472192 00000100:00100000:1.0:1790919113.265781:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 33 00000100:00100000:1.0:1790919113.265791:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd82803b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:10206:x1877914532472192:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790919113.265814:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919113.265834:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c44d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cbd4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919113.265892:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c44dd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919113.265904:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c44dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919113.265916:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c44dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919113.265931:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7fc00/0xc3296956897c44e4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919113.265938:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7fc00/0xc3296956897c44e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919113.265944:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7fc00/0xc3296956897c44e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919113.266161:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ee00/0xc3296956897c44eb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919113.266170:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ee00/0xc3296956897c44eb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919113.266177:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ee00/0xc3296956897c44eb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790919113.266223:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790919113.266226:0:5845:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790919113.266241:0:5845:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ee00/0xc3296956897c44eb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919113.266249:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c44dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919113.266253:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c44dd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919113.266258:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c44dd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919113.266262:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88beb3f7e200 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:1.0:1790919113.266265:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c44dd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919113.266270:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c44dd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919113.266287:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be8b621200) 00010000:00010000:1.0:1790919113.266289:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919113.266292:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c44dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919113.266296:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c44dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919113.266306:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7fc00/0xc3296956897c44e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919113.266317:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7fc00/0xc3296956897c44e4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919113.266321:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7fc00/0xc3296956897c44e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919113.266324:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88beb3f7fc00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:1.0:1790919113.266325:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7fc00/0xc3296956897c44e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919113.266329:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7fc00/0xc3296956897c44e4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919113.266333:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff88be8b621600) 00010000:00010000:1.0:1790919113.266334:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919113.266336:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7fc00/0xc3296956897c44e4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919113.266339:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7fc00/0xc3296956897c44e4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919113.266364:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c44d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cbd4 expref: 8 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919113.266373:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ee00/0xc3296956897c44eb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cbd4 expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919113.266377:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88be8b621700) 00010000:00010000:1.0:1790919113.266379:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790919113.266384:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88beb3f7ee00, rc 0) 00000100:00100000:1.0:1790919113.266456:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd82803b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:10206:x1877914532472192:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 657us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919113.266464:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 33 00000100:00100000:3.0:1790919113.268992:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919113.269510:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532472448 00000100:00100000:2.0:1790919113.269523:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532472448 00000100:00100000:2.0:1790919113.269658:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 34 00000100:00100000:2.0:1790919113.269670:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb413a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:10206:x1877914532472448:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790919113.269692:0:8231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919113.269717:0:8231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c44f2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cbdb expref: -99 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919113.269812:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c44f9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919113.269828:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c44f9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919113.269840:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c44f9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919113.269930:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4500 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919113.269940:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4500 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919113.269947:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4500 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919113.270321:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386000/0xc3296956897c4507 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919113.270331:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386000/0xc3296956897c4507 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919113.270338:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386000/0xc3296956897c4507 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919113.270348:0:8231:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1790919113.270518:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c44f9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919113.270569:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c44f9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919113.270577:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c44f9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919113.270583:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88387a00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919113.270587:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c44f9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919113.270605:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c44f9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919113.270617:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88be8b621700) 00010000:00010000:2.0:1790919113.270620:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919113.270625:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c44f9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919113.270631:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c44f9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919113.270644:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4500 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919113.270649:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4500 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919113.270655:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4500 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919113.270660:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88387400 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919113.270663:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4500 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919113.270669:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4500 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919113.270675:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff88be85efce00) 00010000:00010000:2.0:1790919113.270678:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919113.270680:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4500 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919113.270695:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4500 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919113.271161:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c44f2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cbdb expref: 10 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919113.271178:0:8231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386000/0xc3296956897c4507 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cbdb expref: 9 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919113.271185:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88be85efcb00) 00010000:00010000:2.0:1790919113.271188:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919113.271191:0:8231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be88386000, rc 0) 00000100:00100000:2.0:1790919113.271276:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb413a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+9:10206:x1877914532472448:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 1608us (2294us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1790919113.271285:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 34 00000100:00100000:2.0:1790919113.280861:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919113.285635:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532472576 00000100:00100000:0.0:1790919113.285650:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532472576 00000100:00100000:0.0:1790919113.286062:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 35 00000100:00100000:0.0:1790919113.286075:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88d98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+9:10206:x1877914532472576:12345-192.168.201.27@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1790919113.286237:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88d98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+9:10206:x1877914532472576:12345-192.168.201.27@tcp:59:lhsmtool_posix.0 Request processed in 164us (5384us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919113.286245:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 35 00000100:00100000:3.0:1790919113.422850:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919113.422910:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919113.423222:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532472832 00000100:00100000:1.0:1790919113.423233:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532472832 00000100:00100000:1.0:1790919113.423318:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 129 00000100:00100000:1.0:1790919113.423328:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb413b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5591729f-44f1-43f1-b042-c3a508737d97+5:2353:x1877914532472832:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:1.0:1790919113.423408:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb413b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5591729f-44f1-43f1-b042-c3a508737d97+5:2353:x1877914532472832:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 81us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919113.423416:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 129 00000100:00100000:2.0:1790919113.423946:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532472704 00000100:00100000:2.0:1790919113.423953:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532472704 00000100:00100000:2.0:1790919113.423995:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 285 00000100:00100000:2.0:1790919113.424003:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+13:2353:x1877914532472704:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:2.0:1790919113.424034:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+13:2353:x1877914532472704:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 32us (1194us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919113.424040:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 285 00000100:00080000:3.0:1790919113.424338:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1790919113.923243:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790919113.984512:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919115.008083:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550335360:0@lo:400:kworker.0 00000100:00100000:3.0:1790919115.008157:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919115.008231:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1790919115.008237:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3307:1877914550334976:0@lo:400:kworker.0 00000100:00100000:3.0:1790919115.008270:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919115.008292:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1877914550335488:0@lo:400:kworker.0 00000100:00100000:3.0:1790919115.008317:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919115.008392:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550335360 00000100:00100000:1.0:1790919115.008402:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550335360 00000100:00100000:1.0:1790919115.008497:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790919115.008507:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb413bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550335360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919115.008585:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb413bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550335360:12345-0@lo:400:kworker.0 Request processed in 79us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919115.008592:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790919115.008617:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550334976 00000100:00100000:1.0:1790919115.008620:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550334976 00000100:00100000:1.0:1790919115.008645:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1790919115.008652:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3307:x1877914550334976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919115.008684:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3307:x1877914550334976:12345-0@lo:400:kworker.0 Request processed in 33us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919115.008691:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1790919115.008740:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3307:1877914550334976:0@lo:400:kworker.0 00000100:00100000:1.0:1790919115.008769:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550335360:0@lo:400:kworker.0 00000100:00100000:2.0:1790919115.008847:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1877914550335232:0@lo:400:kworker.0 00000100:00100000:2.0:1790919115.008879:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919115.008919:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1790919115.008926:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877914550335104:0@lo:400:kworker.0 00000100:00100000:2.0:1790919115.008948:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919115.008964:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550335616:0@lo:400:kworker.0 00000100:00100000:2.0:1790919115.008984:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919115.009008:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550335488 00000100:00100000:2.0:1790919115.009012:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550335488 00000100:00100000:2.0:1790919115.009039:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550335232 00000100:00100000:2.0:1790919115.009042:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550335232 00000100:00100000:2.0:1790919115.009056:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550335104 00000100:00100000:2.0:1790919115.009058:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550335104 00000100:00100000:2.0:1790919115.009070:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1790919115.009076:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877914550335488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919115.009110:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877914550335488:12345-0@lo:400:kworker.0 Request processed in 34us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919115.009116:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1790919115.009129:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1790919115.009135:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88d9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877914550335232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919115.009175:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88d9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877914550335232:12345-0@lo:400:kworker.0 Request processed in 40us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919115.009180:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1790919115.009193:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1790919115.009199:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88d98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877914550335104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919115.009225:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88d98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877914550335104:12345-0@lo:400:kworker.0 Request processed in 27us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919115.009231:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1790919115.009260:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877914550335104:0@lo:400:kworker.0 00000100:00100000:2.0:1790919115.009279:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1877914550335232:0@lo:400:kworker.0 00000100:00080000:3.0:1790919115.009359:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790919115.009364:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790919115.009431:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550335616 00000100:00100000:1.0:1790919115.009435:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550335616 00000100:00100000:1.0:1790919115.009473:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790919115.009480:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88d98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550335616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919115.009516:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88d98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550335616:12345-0@lo:400:kworker.0 Request processed in 37us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919115.009521:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:1.0:1790919115.009568:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88beb3b39880 x1877914550335616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919115.009579:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550335616:0@lo:400:kworker.0 00000100:00100000:1.0:1790919115.009601:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1877914550335488:0@lo:400:kworker.0 00000100:00080000:3.0:1790919115.013569:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1790919115.014249:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919115.523830:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550335744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790919115.523912:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919115.524019:0:11721:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550335744 00000100:00100000:1.0:1790919115.524027:0:11721:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550335744 00000100:00100000:1.0:1790919115.524081:0:11721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790919115.524091:0:11721:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88d99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550335744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790919115.524127:0:11721:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919115.524173:0:11721:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88d99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550335744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919115.524181:0:11721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:2.0:1790919115.524260:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88beb3b39880 x1877914550335744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919131 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919115.524277:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550335744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790919115.926633:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919115.926821:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532472960 00000100:00100000:3.0:1790919115.926831:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532472960 00000100:00100000:3.0:1790919115.926901:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 36 00000100:00100000:3.0:1790919115.926910:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88d99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+9:10248:x1877914532472960:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:3.0:1790919115.926929:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919115.926951:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4515 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cbe2 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919115.927014:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c451c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919115.927030:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c451c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919115.927042:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c451c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919115.927057:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c4523 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919115.927074:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c4523 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919115.927082:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c4523 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919115.927271:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c451c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919115.927279:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c451c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919115.927286:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c451c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919115.927291:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81672e00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919115.927295:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c451c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919115.927303:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c451c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919115.927314:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be8b621200) 00010000:00010000:3.0:1790919115.927317:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919115.927322:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c451c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919115.927327:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c451c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919115.927340:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c4523 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919115.927352:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c4523 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919115.927358:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c4523 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919115.927374:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81672400 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919115.927377:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c4523 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919115.927383:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c4523 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919115.927392:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff88be88e22e00) 00010000:00010000:3.0:1790919115.927394:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919115.927397:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c4523 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919115.927411:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c4523 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919115.927445:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4515 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cbe2 expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919115.927454:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be8b621200) 00010000:00010000:3.0:1790919115.927457:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919115.927460:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4515 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cbe2 expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919115.927469:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81672c00, rc 0) 00000100:00100000:3.0:1790919115.927563:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88d99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+9:10248:x1877914532472960:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 654us (940us total) trans 0 rc 301/301 00000100:00100000:3.0:1790919115.927571:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 36 00000100:00080000:1.0:1790919115.928056:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790919115.942841:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919115.942926:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532473216 00000100:00100000:2.0:1790919115.942938:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532473216 00000100:00100000:2.0:1790919115.943009:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 37 00000100:00100000:2.0:1790919115.943020:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+9:10248:x1877914532473216:12345-192.168.201.27@tcp:36:lfs.0 00010000:00010000:2.0:1790919115.943077:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919115.943107:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e000/0xc3296956897c44cf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cbcd expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919115.943128:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be8b621200) 00010000:00010000:2.0:1790919115.943139:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790919115.948791:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c452a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919115.948814:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c452a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919115.948826:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c452a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919115.948839:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4531 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919115.948855:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4531 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919115.948863:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4531 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919115.953740:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1790919115.953769:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c452a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919115.953780:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c452a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919115.953788:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c452a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919115.953795:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386600 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919115.953799:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c452a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919115.953808:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c452a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919115.953825:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be85efce00) 00010000:00010000:2.0:1790919115.953828:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919115.953834:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c452a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919115.953840:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c452a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790919115.953876:0:5847:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000016cc5cc9 reply state 000000007af834bf transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4531 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919115.953885:0:5847:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790919115.954017:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+10:10248:x1877914532473216:12345-192.168.201.27@tcp:36:lfs.0 Request processed in 10993us (11181us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1790919115.954027:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 37 00010000:00010000:2.0:1790919115.956819:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4531 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919115.956836:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4531 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919115.956843:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4531 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919115.956850:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386c00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919115.956853:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4531 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919115.956861:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4531 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919115.956876:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff88be85efc400) 00010000:00010000:2.0:1790919115.956879:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919115.956884:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4531 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919115.956890:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4531 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.040878:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919116.143325:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919116.143440:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532473344 00000100:00100000:3.0:1790919116.143494:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532473344 00000100:00100000:3.0:1790919116.143580:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 38 00000100:00100000:3.0:1790919116.143590:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+9:10256:x1877914532473344:12345-192.168.201.27@tcp:101:lctl.0 00010000:00010000:3.0:1790919116.143616:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919116.143639:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4538 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cbe9 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.143705:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c453f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.143719:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c453f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.143730:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c453f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919116.143768:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790919116.143771:0:5845:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790919116.143807:0:5845:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c453f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.143830:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4538 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cbe9 expref: 11 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.143862:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c453f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cbe9 expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.143886:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be88e22e00) 00010000:00010000:3.0:1790919116.143890:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790919116.143893:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81672400, rc 0) 00000100:00100000:3.0:1790919116.143961:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+10:10256:x1877914532473344:12345-192.168.201.27@tcp:101:lctl.0 Request processed in 372us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919116.143969:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 38 00000100:00100000:3.0:1790919116.290181:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919116.290290:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532473472 00000100:00100000:1.0:1790919116.290301:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532473472 00000100:00100000:1.0:1790919116.290360:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 39 00000100:00100000:1.0:1790919116.290372:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+10:10262:x1877914532473472:12345-192.168.201.27@tcp:101:bash.0 00010000:00010000:1.0:1790919116.290416:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919116.290438:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7fe00/0xc3296956897c4546 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cbf0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.290506:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c454d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.290519:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c454d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.290549:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c454d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.290564:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e000/0xc3296956897c4554 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.290572:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e000/0xc3296956897c4554 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.290577:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e000/0xc3296956897c4554 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.290665:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f000/0xc3296956897c455b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.290673:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f000/0xc3296956897c455b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.290680:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f000/0xc3296956897c455b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790919116.290706:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1790919116.290714:0:5846:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790919116.290757:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f000/0xc3296956897c455b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.290768:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c454d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.290774:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c454d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.290781:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c454d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.290787:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88beb3f7e800 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:1.0:1790919116.290791:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c454d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.290798:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c454d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.290810:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be88e22e00) 00010000:00010000:1.0:1790919116.290814:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919116.290818:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c454d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.290825:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c454d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.290839:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e000/0xc3296956897c4554 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.290845:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e000/0xc3296956897c4554 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.290861:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e000/0xc3296956897c4554 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.290866:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88beb3f7e000 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:1.0:1790919116.290868:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e000/0xc3296956897c4554 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.290882:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e000/0xc3296956897c4554 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.290890:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff88be8b621000) 00010000:00010000:1.0:1790919116.290893:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919116.290896:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e000/0xc3296956897c4554 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.290901:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e000/0xc3296956897c4554 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.290933:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7fe00/0xc3296956897c4546 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cbf0 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.290948:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f000/0xc3296956897c455b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cbf0 expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.290954:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88be8b621100) 00010000:00010000:1.0:1790919116.290956:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1790919116.290958:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88beb3f7f000, rc 0) 00000100:00100000:1.0:1790919116.291024:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+11:10262:x1877914532473472:12345-192.168.201.27@tcp:101:bash.0 Request processed in 654us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919116.291040:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 39 00000100:00100000:0.0:1790919116.301422:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919116.301512:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532473728 00000100:00100000:3.0:1790919116.301522:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532473728 00000100:00100000:3.0:1790919116.301620:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 40 00000100:00100000:3.0:1790919116.301630:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+11:10262:x1877914532473728:12345-192.168.201.27@tcp:101:bash.0 00010000:00010000:3.0:1790919116.301650:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919116.301670:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4562 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cbf7 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.301788:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4569 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.301803:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4569 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.301813:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4569 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.301876:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673600/0xc3296956897c4570 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.301885:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673600/0xc3296956897c4570 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.301906:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673600/0xc3296956897c4570 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790919116.302423:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1790919116.302623:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4577 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.302635:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4577 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.302642:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4577 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.302674:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4569 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.302681:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4569 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.302689:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4569 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.302694:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81672e00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919116.302699:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4569 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.302706:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4569 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.302718:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88be8b621100) 00010000:00010000:3.0:1790919116.302721:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919116.302732:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4569 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.302738:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4569 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790919116.302750:0:5845:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003eba5682 reply state 00000000620274d5 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673600/0xc3296956897c4570 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919116.302757:0:5845:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790919116.302787:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4562 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cbf7 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.302800:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4577 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cbf7 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.302808:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be88e22a00) 00010000:00010000:3.0:1790919116.302810:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790919116.302812:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81673800, rc 0) 00000100:00100000:3.0:1790919116.302875:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+14:10262:x1877914532473728:12345-192.168.201.27@tcp:101:bash.0 Request processed in 1246us (1462us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1790919116.302883:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 40 00010000:00010000:2.0:1790919116.307044:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673600/0xc3296956897c4570 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919116.307063:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673600/0xc3296956897c4570 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919116.307071:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673600/0xc3296956897c4570 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919116.307078:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81673600 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919116.307083:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673600/0xc3296956897c4570 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919116.307090:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673600/0xc3296956897c4570 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919116.307107:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88be88e22f00) 00010000:00010000:2.0:1790919116.307110:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919116.307115:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673600/0xc3296956897c4570 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919116.307121:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673600/0xc3296956897c4570 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919116.309766:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919116.309952:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532473856 00000100:00100000:2.0:1790919116.309962:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532473856 00000100:00100000:2.0:1790919116.310006:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 20 00000100:00100000:2.0:1790919116.310014:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2349:x1877914532473856:12345-192.168.201.27@tcp:8:bash.0 00010000:00080000:2.0:1790919116.310046:0:6700:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from c4a4e085-55d7-40e9-993c-11b4dfc2d5f5@192.168.201.27@tcp t0 exp 0000000000000000 cur 318 last 0 00000020:00000080:2.0:1790919116.310095:0:6700:0:(genops.c:1384:class_connect()) connect: client c4a4e085-55d7-40e9-993c-11b4dfc2d5f5, cookie 0xc3296956897c4585 00002000:00100000:2.0:1790919116.310107:0:6700:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c4a4e085-55d7-40e9-993c-11b4dfc2d5f5/ffff88be85453800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790919116.310117:0:6700:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790919116.310360:0:6700:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790919116.310391:0:6700:0:(import.c:65:import_set_state_nolock()) ffff88be85450800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790919116.310477:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2349:x1877914532473856:12345-192.168.201.27@tcp:8:bash.0 Request processed in 462us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919116.310486:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 20 00000100:00100000:3.0:1790919116.313375:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919116.313473:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532473984 00000100:00100000:1.0:1790919116.313484:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532473984 00000100:00100000:1.0:1790919116.313580:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 21 00000100:00100000:1.0:1790919116.313589:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:0:x1877914532473984:12345-192.168.201.27@tcp:101:bash.0 00010000:00010000:1.0:1790919116.313606:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919116.313627:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068e31704/0xc3296956897c458c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cbfe expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790919116.313653:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790919116.313668:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=318s v=(0 0) 00010000:00010000:1.0:1790919116.313673:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919116.313683:0:6699:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068e31704/0xc3296956897c458c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cbfe expref: 7 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.313702:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000068e31704/0xc3296956897c458c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cbfe expref: 7 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.313714:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88beb3f7fe00, rc 0) 00000100:00080000:3.0:1790919116.313839:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790919116.313965:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:0:x1877914532473984:12345-192.168.201.27@tcp:101:bash.0 Request processed in 376us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919116.313972:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 21 00000100:00100000:3.0:1790919116.330194:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919116.330301:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532474112 00000100:00100000:2.0:1790919116.330312:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532474112 00000100:00100000:2.0:1790919116.330382:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 22 00000100:00100000:2.0:1790919116.330400:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:10262:x1877914532474112:12345-192.168.201.27@tcp:101:bash.0 00010000:00010000:2.0:1790919116.330420:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919116.330442:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6f6e2c1/0xc3296956897c4593 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cc05 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919116.330475:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000068e31704/0xc3296956897c458c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cbfe expref: 8 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919116.330483:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919116.330487:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919116.330492:0:6700:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6f6e2c1/0xc3296956897c4593 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc05 expref: 8 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919116.330566:0:6700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000068e31704/0xc3296956897c458c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cbfe expref: 8 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919116.330602:0:6700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000068e31704/0xc3296956897c458c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cbfe expref: 8 pid: 6699 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919116.330616:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb0b1ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6700:1877914550335872:192.168.201.27@tcp:104: 00000100:00100000:2.0:1790919116.330709:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb3b5c180 going to sleep for 11 seconds 00000100:00100000:0.0:1790919116.341577:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919116.341725:0:8529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532474240 00000100:00100000:1.0:1790919116.341734:0:8529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532474240 00010000:00010000:1.0:1790919116.341773:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000068e31704/0xc3296956897c458c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cbfe expref: 9 pid: 6699 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919116.341839:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 35 00000100:00100000:1.0:1790919116.341849:0:8529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+9:2352:x1877914532474240:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790919116.341865:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919116.341890:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000068e31704/0xc3296956897c458c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cbfe expref: 9 pid: 6699 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.341904:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000068e31704/0xc3296956897c458c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cbfe expref: 9 pid: 6699 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.341933:0:8529:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919116.341937:0:8529:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919116.341946:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b6f6e2c1/0xc3296956897c4593 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc05 expref: 9 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.341957:0:8529:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6f6e2c1/0xc3296956897c4593 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc05 expref: 9 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.341995:0:8529:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b6f6e2c1/0xc3296956897c4593 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc05 expref: 9 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919116.342016:0:8529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8529:1877914550336000:192.168.201.27@tcp:105: 00000100:00100000:1.0:1790919116.342110:0:8529:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bebfbc9840 going to sleep for 11 seconds 00010000:00010000:2.0:1790919116.343350:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068e31704/0xc3296956897c458c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cbfe expref: 9 pid: 6699 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919116.343384:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb0b1ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6700:1877914550335872:192.168.201.27@tcp:104: 00010000:00010000:2.0:1790919116.343419:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b6f6e2c1/0xc3296956897c4593 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc05 expref: 8 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919116.343431:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be88386c00, rc 0) 00000100:00100000:2.0:1790919116.343487:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+8:10262:x1877914532474112:12345-192.168.201.27@tcp:101:bash.0 Request processed in 13096us (13301us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919116.343495:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 22 00000100:00100000:1.0:1790919116.347802:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919116.347976:0:8529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8529:1877914550336000:192.168.201.27@tcp:105: 00010000:00010000:2.0:1790919116.348001:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919116.348072:0:8529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:2352:x1877914532474240:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 6225us (6544us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919116.348082:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 35 00000100:00100000:3.0:1790919116.348131:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532474496 00000100:00100000:3.0:1790919116.348143:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532474496 00000100:00100000:3.0:1790919116.348220:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 6 00000100:00100000:3.0:1790919116.348230:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+13:10262:x1877914532474496:12345-192.168.201.27@tcp:35:bash.0 00000100:00100000:3.0:1790919116.348764:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+14:10262:x1877914532474496:12345-192.168.201.27@tcp:35:bash.0 Request processed in 532us (975us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1790919116.348773:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 6 00000100:00100000:3.0:1790919116.477899:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919116.478086:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532474752 00000100:00100000:1.0:1790919116.478117:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532474752 00000100:00100000:1.0:1790919116.478200:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 41 00000100:00100000:1.0:1790919116.478211:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+14:10272:x1877914532474752:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:1.0:1790919116.478246:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919116.478272:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c459a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cc0c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790919116.478387:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1790919116.478612:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c459a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc0c expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.478629:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be88e22e00) 00010000:00010000:1.0:1790919116.478632:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790919116.478637:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c459a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc0c expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.478656:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88beb3f7e800, rc 0) 00000100:00100000:1.0:1790919116.478751:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+15:10272:x1877914532474752:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 541us (866us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1790919116.478759:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 41 00000100:00100000:1.0:1790919116.482500:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919116.482645:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532475008 00000100:00100000:2.0:1790919116.482659:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532475008 00000100:00100000:2.0:1790919116.482747:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 7 00000100:00100000:2.0:1790919116.482758:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+15:10272:x1877914532475008:12345-192.168.201.27@tcp:35:lfs.0 00000100:00100000:2.0:1790919116.483172:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+16:10272:x1877914532475008:12345-192.168.201.27@tcp:35:lfs.0 Request processed in 414us (686us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1790919116.483328:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 7 00000100:00100000:2.0:1790919116.598951:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919116.599208:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532475136 00000100:00100000:3.0:1790919116.599234:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532475136 00000100:00100000:3.0:1790919116.599317:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 42 00000100:00100000:3.0:1790919116.599331:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+16:10278:x1877914532475136:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:3.0:1790919116.599367:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919116.599404:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c45a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cc13 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.599496:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c45af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.600019:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c45af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.600037:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c45af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919116.600088:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1790919116.600093:0:5845:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790919116.600125:0:5845:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c45af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.602716:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c45a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc13 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.602775:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c45af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc13 expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.602785:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88be8b621100) 00010000:00010000:3.0:1790919116.602789:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790919116.602793:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81672e00, rc 0) 00000100:00100000:3.0:1790919116.604611:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+17:10278:x1877914532475136:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 5267us (5662us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919116.604626:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 42 00000100:00100000:1.0:1790919116.610352:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919116.610593:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532475392 00000100:00100000:2.0:1790919116.610608:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532475392 00000100:00100000:2.0:1790919116.610686:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 43 00000100:00100000:2.0:1790919116.610699:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+17:10278:x1877914532475392:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:2.0:1790919116.610730:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919116.610758:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c45b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cc1a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919116.610912:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c45bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919116.610932:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c45bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919116.610946:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c45bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919116.610960:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1790919116.611146:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c45b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc1a expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919116.611170:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c45bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc1a expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919116.611214:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be88e22a00) 00010000:00010000:2.0:1790919116.611218:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790919116.611223:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be88386e00, rc 0) 00000100:00100000:2.0:1790919116.611308:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+19:10278:x1877914532475392:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 610us (970us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1790919116.611317:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 43 00000100:00100000:0.0:1790919116.619683:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919116.619740:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919116.619795:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532475776 00000100:00100000:3.0:1790919116.619943:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532475648 00000100:00100000:3.0:1790919116.619956:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532475648 00000100:00100000:3.0:1790919116.620028:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 44 00000100:00100000:3.0:1790919116.620040:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+19:10278:x1877914532475648:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:3.0:1790919116.620074:0:8231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919116.620099:0:8231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c45cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cc21 expref: -99 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.620244:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c45d2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.620262:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c45d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.620275:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c45d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919116.620290:0:8231:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1790919116.620489:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c45cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc21 expref: 22 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.620510:0:8231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c45d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc21 expref: 21 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.620520:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be88e22a00) 00010000:00010000:3.0:1790919116.620524:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1790919116.620568:0:8231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81673200, rc 0) 00000100:00100000:3.0:1790919116.620651:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+21:10278:x1877914532475648:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 613us (984us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1790919116.620660:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 44 00000100:00100000:0.0:1790919116.622045:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532475776 00000100:00100000:0.0:1790919116.622566:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 2 00000100:00100000:0.0:1790919116.622582:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+21:2351:x1877914532475776:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790919116.622605:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919116.622639:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c45bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc1a expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919116.622664:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be88e22a00) 00010000:00010000:0.0:1790919116.622669:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919116.622737:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+20:2351:x1877914532475776:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 160us (2996us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919116.622745:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 2 00000100:00100000:2.0:1790919116.642401:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919116.642648:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532475904 00000100:00100000:3.0:1790919116.642661:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532475904 00000100:00100000:3.0:1790919116.642733:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 23 00000100:00100000:3.0:1790919116.642745:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:2352:x1877914532475904:12345-192.168.201.27@tcp:1:lfs.0 00010000:00010000:3.0:1790919116.642832:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f462e5f7/0xc3296956897c45e0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.642859:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b6f6e2c1/0xc3296956897c4593 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc05 expref: 7 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.642869:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919116.642874:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790919116.642880:0:6698:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f462e5f7/0xc3296956897c45e0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.642957:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b6f6e2c1/0xc3296956897c4593 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc05 expref: 7 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.642982:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b6f6e2c1/0xc3296956897c4593 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc05 expref: 7 pid: 6700 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919116.643000:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be83439f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6698:1877914550336128:192.168.201.27@tcp:104: 00000100:00100000:3.0:1790919116.643129:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be90e4a600 going to sleep for 11 seconds 00000001:00100000:1.0:1790919116.651654:0:7662:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c4a4e085-55d7-40e9-993c-11b4dfc2d5f5 00000100:00100000:3.0:1790919116.658027:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be83439f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6698:1877914550336128:192.168.201.27@tcp:104: 00010000:00010000:3.0:1790919116.658072:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f462e5f7/0xc3296956897c45e0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919116.665013:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919116.665143:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532476032 00000100:00100000:1.0:1790919116.665161:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532476032 00002000:00100000:1.0:1790919116.665241:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff88beb0b1dc00 x1877914532476032/t0(0) o4->c4a4e085-55d7-40e9-993c-11b4dfc2d5f5@192.168.201.27@tcp:237/0 lens 504/0 e 0 to 0 dl 1790919127 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790919116.665279:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88beb0b1dc00 with x1877914532476032 ext(0->12) 00010000:00010000:1.0:1790919116.665292:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b6f6e2c1/0xc3296956897c4593 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc05 expref: 7 pid: 6700 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.665313:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b6f6e2c1/0xc3296956897c4593 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc05 expref: 7 pid: 6700 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790919116.665322:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88beb0b1dc00 00000100:00100000:1.0:1790919116.665364:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 0 00000100:00100000:1.0:1790919116.665375:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:2353:x1877914532476032:12345-192.168.201.27@tcp:4:lfs.0 00000100:00100000:1.0:1790919116.666334:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+9:2353:x1877914532476032:12345-192.168.201.27@tcp:4:lfs.0 Request processed in 954us (1326us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1790919116.666348:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 0 00002000:00100000:1.0:1790919116.666357:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff88beb0b1dc00 x1877914532476032/t4294967299(0) o4->c4a4e085-55d7-40e9-993c-11b4dfc2d5f5@192.168.201.27@tcp:237/0 lens 504/448 e 0 to 0 dl 1790919127 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790919116.666369:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88beb0b1dc00 with x1877914532476032 ext(0->12) 00010000:00010000:1.0:1790919116.666378:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b6f6e2c1/0xc3296956897c4593 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc05 expref: 9 pid: 6700 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.666408:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b6f6e2c1/0xc3296956897c4593 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc05 expref: 9 pid: 6700 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790919116.666416:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88beb0b1dc00 00000100:00100000:1.0:1790919116.684073:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919116.686298:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532476160 00000100:00100000:3.0:1790919116.686319:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532476160 00010000:00010000:2.0:1790919116.689002:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b6f6e2c1/0xc3296956897c4593 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc05 expref: 9 pid: 6700 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919116.689155:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 36 00000100:00100000:2.0:1790919116.689170:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+9:2352:x1877914532476160:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790919116.689266:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1790919116.689296:0:5830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1790919116.689299:0:5830:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1790919117 00002000:00010000:2.0:1790919116.689302:0:5830:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1790919117 00002000:00010000:2.0:1790919116.689304:0:5830:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1790919117 00010000:00010000:2.0:1790919116.689313:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b6f6e2c1/0xc3296956897c4593 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc05 expref: 9 pid: 6700 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919116.689331:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b6f6e2c1/0xc3296956897c4593 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc05 expref: 9 pid: 6700 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919116.689365:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6f6e2c1/0xc3296956897c4593 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc05 expref: 9 pid: 6700 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919116.689417:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790919116.689423:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790919116.689431:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f462e5f7/0xc3296956897c45e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919116.689443:0:5830:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f462e5f7/0xc3296956897c45e0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.689770:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f462e5f7/0xc3296956897c45e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.689782:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f462e5f7/0xc3296956897c45e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.689814:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f462e5f7/0xc3296956897c45e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.689834:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f462e5f7/0xc3296956897c45e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.689844:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f462e5f7/0xc3296956897c45e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.689859:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81673600 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:3.0:1790919116.689865:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f462e5f7/0xc3296956897c45e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.689875:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f462e5f7/0xc3296956897c45e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.689890:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f462e5f7/0xc3296956897c45e0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.689898:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f462e5f7/0xc3296956897c45e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919116.690017:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+8:2352:x1877914532475904:12345-192.168.201.27@tcp:1:lfs.0 Request processed in 47273us (47640us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919116.690028:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 23 00010000:00010000:2.0:1790919116.690256:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919116.690285:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:2352:x1877914532476160:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 1119us (6226us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919116.690294:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 36 00000100:00100000:0.0:1790919116.693479:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919116.693761:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532476416 00000100:00100000:1.0:1790919116.693776:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532476416 00000100:00100000:1.0:1790919116.693863:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 8 00000100:00100000:1.0:1790919116.693875:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+20:10278:x1877914532476416:12345-192.168.201.27@tcp:35:lfs.0 00000004:00010000:1.0:1790919116.693974:0:5849:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c45d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc21 expref: 20 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790919116.694980:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1790919116.695050:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1790919116.697442:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1790919116.698435:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c45e7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.698468:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4577 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cbf7 expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.698480:0:5849:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c45e7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.698651:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4577 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cbf7 expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.698673:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4577 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cbf7 expref: 24 pid: 5845 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919116.698695:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac91c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5849:1877914550336256:192.168.201.27@tcp:104: 00000100:00100000:1.0:1790919116.699788:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bebfbc9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790919116.706588:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac91c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5849:1877914550336256:192.168.201.27@tcp:104: 00010000:00010000:1.0:1790919116.706662:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c45e7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919116.709244:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919116.709443:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532476544 00000100:00100000:3.0:1790919116.709459:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532476544 00010000:00010000:3.0:1790919116.709545:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4577 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cbf7 expref: 25 pid: 5845 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919116.709596:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 37 00000100:00100000:3.0:1790919116.709609:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+25:2352:x1877914532476544:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919116.709629:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919116.709637:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4577 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cbf7 expref: 25 pid: 5845 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.709672:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4577 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cbf7 expref: 25 pid: 5845 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.709703:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4577 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cbf7 expref: 25 pid: 5845 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.709724:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be88e22a00) 00010000:00010000:3.0:1790919116.709731:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c45e7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.709742:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c45e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.709750:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c45e7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919116.709786:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919116.710037:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+24:2352:x1877914532476544:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 429us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919116.710046:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 37 00010000:00010000:1.0:1790919116.710623:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c45e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.710635:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c45e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790919116.710816:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1790919116.711095:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1790919116.711491:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac91c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1877914550336384:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1790919116.712885:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919116.712933:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bebfbc9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790919116.713159:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550336384 00000100:00100000:0.0:1790919116.713172:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550336384 00000100:00100000:0.0:1790919116.713372:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790919116.713382:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf78bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1877914550336384:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790919116.713563:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf78bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1877914550336384:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 182us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919116.713571:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790919116.714849:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac91c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1877914550336384:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1790919116.718055:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1790919116.718891:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be83439f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1877914550336512:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1790919116.718990:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919116.719036:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be84c9dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919116.725743:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550336512 00000100:00100000:0.0:1790919116.725770:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550336512 00000100:00100000:0.0:1790919116.725870:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790919116.725883:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be8343b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1877914550336512:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790919116.726292:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be8343b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5849:x1877914550336512:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 410us (7301us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1790919116.726302:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790919116.726374:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be83439f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1877914550336512:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1790919116.726499:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1790919116.726609:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c45e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.726622:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c45e7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.726631:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c45e7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.726638:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88beb3f7e800 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:1.0:1790919116.726643:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c45e7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.726653:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c45e7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.726689:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be88e22a00) 00010000:00010000:1.0:1790919116.726692:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1790919116.726699:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c45e7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.726705:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c45e7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790919116.727196:0:5849:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1790919116.727496:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1790919116.727512:0:5849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 318615984456ns, next at 319615981327ns, rc = 0 00000001:00080000:1.0:1790919116.727520:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1790919116.727648:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be88e22a00) 00010000:00010000:1.0:1790919116.727653:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1790919116.727663:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c45d2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc21 expref: 28 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919116.727828:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+27:10278:x1877914532476416:12345-192.168.201.27@tcp:35:lfs.0 Request processed in 33954us (34363us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1790919116.727839:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 8 00000020:00080000:1.0:1790919116.727844:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1790919116.735666:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919116.735832:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532476672 00000100:00100000:2.0:1790919116.735846:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532476672 00000100:00100000:2.0:1790919116.735920:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 45 00000100:00100000:2.0:1790919116.735932:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+27:10278:x1877914532476672:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:2.0:1790919116.735971:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919116.736004:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c45ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cc28 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919116.736092:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c45ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc28 expref: 28 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919116.736111:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c45ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc28 expref: 28 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919116.736174:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be85efce00) 00010000:00010000:2.0:1790919116.736261:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790919116.736266:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be88386c00, rc 0) 00000100:00100000:2.0:1790919116.736346:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+28:10278:x1877914532476672:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 416us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919116.736353:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 45 00000100:00100000:3.0:1790919116.740023:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919116.741253:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532476928 00000100:00100000:0.0:1790919116.741273:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532476928 00000100:00100000:0.0:1790919116.741428:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 9 00000100:00100000:0.0:1790919116.741441:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9290b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+28:10278:x1877914532476928:12345-192.168.201.27@tcp:35:lfs.0 00000100:00100000:0.0:1790919116.741812:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9290b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+29:10278:x1877914532476928:12345-192.168.201.27@tcp:35:lfs.0 Request processed in 361us (1792us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1790919116.741913:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 9 00000100:00100000:3.0:1790919116.909400:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919116.912118:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532477184 00000100:00100000:2.0:1790919116.912143:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532477184 00000100:00100000:2.0:1790919116.912258:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 46 00000100:00100000:2.0:1790919116.912271:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be83439500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+29:10288:x1877914532477184:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:2.0:1790919116.912305:0:8231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919116.912334:0:8231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c45f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cc2f expref: -99 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919116.912479:0:8231:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1790919116.912681:0:8231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c45f5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc2f expref: 31 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919116.912699:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be88e22e00) 00010000:00010000:2.0:1790919116.912703:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790919116.912709:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c45f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc2f expref: 31 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919116.912726:0:8231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be88386600, rc 0) 00000100:00100000:2.0:1790919116.912837:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be83439500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+30:10288:x1877914532477184:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 567us (3472us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1790919116.912867:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 46 00000100:00100000:2.0:1790919116.926069:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919116.926331:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532477312 00000100:00100000:1.0:1790919116.926346:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532477312 00000100:00100000:1.0:1790919116.926443:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 47 00000100:00100000:1.0:1790919116.926456:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+30:10288:x1877914532477312:12345-192.168.201.27@tcp:34:lfs.0 00010000:00010000:1.0:1790919116.926656:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c4603 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.926707:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c4603 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.926726:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c4603 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.926748:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f600/0xc3296956897c460a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.926756:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f600/0xc3296956897c460a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.926764:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f600/0xc3296956897c460a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.926889:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ea00/0xc3296956897c4611 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.926898:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ea00/0xc3296956897c4611 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.926905:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ea00/0xc3296956897c4611 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790919116.927120:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ea00/0xc3296956897c4611 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.927139:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c4603 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.927147:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c4603 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.927168:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c4603 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.927262:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88beb3f7e800 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:1.0:1790919116.927268:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c4603 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.927278:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c4603 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.927293:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88be8b621100) 00010000:00010000:1.0:1790919116.927297:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919116.927302:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c4603 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.927310:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c4603 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.927329:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f600/0xc3296956897c460a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.927335:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f600/0xc3296956897c460a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.927341:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f600/0xc3296956897c460a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.927346:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88beb3f7f600 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:1.0:1790919116.927349:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f600/0xc3296956897c460a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.927519:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f600/0xc3296956897c460a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.927584:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88be8b621300) 00010000:00010000:1.0:1790919116.927587:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919116.927590:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f600/0xc3296956897c460a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.927596:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f600/0xc3296956897c460a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.927619:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ea00/0xc3296956897c4611 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.927625:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ea00/0xc3296956897c4611 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.927631:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ea00/0xc3296956897c4611 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.927636:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88beb3f7ea00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:1.0:1790919116.927639:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ea00/0xc3296956897c4611 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.927645:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ea00/0xc3296956897c4611 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.927653:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be85efce00) 00010000:00010000:1.0:1790919116.927655:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919116.927658:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ea00/0xc3296956897c4611 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919116.927679:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ea00/0xc3296956897c4611 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919116.927816:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+30:10288:x1877914532477312:12345-192.168.201.27@tcp:34:lfs.0 Request processed in 1358us (1759us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919116.927827:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 47 00000100:00100000:0.0:1790919116.933550:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919116.933771:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532477568 00000100:00100000:1.0:1790919116.933785:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532477568 00000100:00100000:1.0:1790919116.933876:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 10 00000100:00100000:1.0:1790919116.933889:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+30:10288:x1877914532477568:12345-192.168.201.27@tcp:35:lfs.0 00000100:00100000:1.0:1790919116.934683:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+31:10288:x1877914532477568:12345-192.168.201.27@tcp:35:lfs.0 Request processed in 793us (1171us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1790919116.934708:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 10 00000100:00100000:3.0:1790919117.007828:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919117.007974:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532477824 00000100:00100000:2.0:1790919117.007987:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532477824 00000100:00100000:2.0:1790919117.008086:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 48 00000100:00100000:2.0:1790919117.008101:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be8343b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+31:10291:x1877914532477824:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:2.0:1790919117.008136:0:8231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919117.008165:0:8231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4618 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cc36 expref: -99 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919117.008308:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c461f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919117.008327:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c461f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919117.008341:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c461f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919117.008359:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c4626 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919117.008377:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c4626 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919117.008392:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c4626 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919117.008587:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c462d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919117.008605:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c462d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919117.008612:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c462d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919117.008625:0:8231:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1790919117.008751:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c461f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919117.008760:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c461f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919117.008768:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c461f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919117.008775:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386200 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919117.008780:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c461f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919117.008789:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c461f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919117.008803:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88be8b621100) 00010000:00010000:2.0:1790919117.008806:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919117.008812:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c461f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919117.008817:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c461f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919117.008834:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c4626 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919117.008846:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c4626 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919117.008851:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c4626 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919117.008856:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386e00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919117.008858:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c4626 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919117.008864:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c4626 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919117.008871:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88be85efc700) 00010000:00010000:2.0:1790919117.008873:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919117.008876:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c4626 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919117.008881:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c4626 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919117.008931:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4618 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc36 expref: 34 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919117.008946:0:8231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c462d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc36 expref: 33 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919117.008953:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be85efce00) 00010000:00010000:2.0:1790919117.008956:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790919117.008965:0:8231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be88387c00, rc 0) 00000100:00100000:2.0:1790919117.009062:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be8343b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+33:10291:x1877914532477824:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 965us (1267us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1790919117.009071:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 48 00000100:00080000:3.0:1790919117.009332:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790919117.013743:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919117.016400:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532477952 00000100:00100000:2.0:1790919117.016424:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532477952 00000100:00100000:2.0:1790919117.016548:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 49 00000100:00100000:2.0:1790919117.016562:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf788700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+33:10291:x1877914532477952:12345-192.168.201.27@tcp:54:lfs.0 00010000:00010000:2.0:1790919117.016665:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c463b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919117.016687:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c463b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919117.016703:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c463b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919117.016739:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c463b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919117.016747:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c463b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919117.016756:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c463b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919117.016763:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88387400 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919117.016768:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c463b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919117.016778:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c463b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919117.016812:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be85efce00) 00010000:00010000:2.0:1790919117.016816:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790919117.016821:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c463b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919117.016827:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c463b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919117.016949:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf788700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+33:10291:x1877914532477952:12345-192.168.201.27@tcp:54:lfs.0 Request processed in 389us (3215us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919117.016958:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 49 00000100:00100000:1.0:1790919117.030194:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919117.030524:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532478208 00000100:00100000:3.0:1790919117.030577:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532478208 00000100:00100000:3.0:1790919117.030636:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 11 00000100:00100000:3.0:1790919117.030648:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf78aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+33:10291:x1877914532478208:12345-192.168.201.27@tcp:35:lfs.0 00000100:00100000:3.0:1790919117.030874:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf78aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+34:10291:x1877914532478208:12345-192.168.201.27@tcp:35:lfs.0 Request processed in 228us (690us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1790919117.030882:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 11 00010000:00010000:2.0:1790919117.056043:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790919117.180804:0:5869:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967326 is committed 00000001:00080000:0.0:1790919117.181108:0:5869:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967328 is committed 00000004:00080000:0.0:1790919117.181120:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1790919117.181596:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790919117.181624:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf789c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550336640:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1790919117.181721:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919117.181804:0:10350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550336640 00000100:00100000:1.0:1790919117.181814:0:10350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550336640 00000100:00100000:1.0:1790919117.181992:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790919117.182003:0:10350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88db5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1877914550336640:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1790919117.182041:0:10350:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1790919117.182085:0:10350:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6abf41cd, atime: 0x6abf41cd, ctime: 0x6abf41cd, blocks: 0x1 00010000:00010000:1.0:1790919117.182095:0:10350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000007899b5/0xc3296956897c4642 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919117.192289:0:10350:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=319s v=(0 0) 00010000:00010000:1.0:1790919117.192297:0:10350:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919117.192308:0:10350:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000007899b5/0xc3296956897c4642 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919117.192337:0:10350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000007899b5/0xc3296956897c4642 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919117.192351:0:10350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000007899b5/0xc3296956897c4642 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919117.192361:0:10350:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000007899b5/0xc3296956897c4642 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919117.192404:0:10350:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790919117.193256:0:10350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88db5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3308:x1877914550336640:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11247us (11527us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1790919117.193269:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1790919117.193326:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1790919117.193512:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919117.193522:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000007899b5/0xc3296956897c4642 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919117.193564:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88beb3f7e800 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:1.0:1790919117.193570:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000007899b5/0xc3296956897c4642 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919117.193599:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000007899b5/0xc3296956897c4642 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919117.193622:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000007899b5/0xc3296956897c4642 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919117.193631:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000007899b5/0xc3296956897c4642 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919117.193662:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919117.193664:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919117.193666:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1790919117.193717:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88bebf789c00/2, rc 0, transno 4294967301 00000100:00100000:1.0:1790919117.193727:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf789c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550336640:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1790919117.194343:0:11980:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967329 is committed 00000001:00080000:2.0:1790919117.194370:0:11980:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967330 is committed 00000020:00080000:2.0:1790919117.194389:0:11980:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88be85663480 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1790919117.194394:0:11980:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88be840ac800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88be90e4a600 00000020:00080000:2.0:1790919117.194397:0:11980:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88be840aca00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88beba115c00 00000020:00080000:3.0:1790919117.194458:0:5880:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1790919117.194629:0:5880:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1790919117.490872:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919117.492752:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532478464 00000100:00100000:2.0:1790919117.492774:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532478464 00000100:00100000:2.0:1790919117.492888:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 50 00000100:00100000:2.0:1790919117.492901:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be8343a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+12:10322:x1877914532478464:12345-192.168.201.27@tcp:101:cat.0 00010000:00010000:2.0:1790919117.492935:0:8231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919117.492963:0:8231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4649 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cc3d expref: -99 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919117.493103:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4650 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919117.493146:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4650 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919117.493162:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4650 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919117.493177:0:8231:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1790919117.493523:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4649 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc3d expref: 15 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919117.493601:0:8231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4650 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc3d expref: 14 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919117.493610:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be85efce00) 00010000:00010000:2.0:1790919117.493613:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790919117.493618:0:8231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be88386600, rc 0) 00000100:00100000:2.0:1790919117.499513:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be8343a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+14:10322:x1877914532478464:12345-192.168.201.27@tcp:101:cat.0 Request processed in 6592us (8634us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1790919117.499547:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 50 00000100:00100000:1.0:1790919117.514983:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919117.516236:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919117.516477:0:8529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532478848 00000100:00100000:1.0:1790919117.516498:0:8529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532478848 00000100:00100000:1.0:1790919117.516610:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 3 00000100:00100000:1.0:1790919117.516621:0:8529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be91cad850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+14:2352:x1877914532478848:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790919117.516637:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919117.516663:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4650 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc3d expref: 14 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919117.516685:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be85efce00) 00010000:00010000:1.0:1790919117.516690:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919117.516770:0:8529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be91cad850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+13:2352:x1877914532478848:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 150us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919117.516778:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 3 00000100:00100000:0.0:1790919117.527868:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532478720 00000100:00100000:0.0:1790919117.527892:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532478720 00000100:00100000:0.0:1790919117.527996:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 12 00000100:00100000:0.0:1790919117.528028:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+13:10322:x1877914532478720:12345-192.168.201.27@tcp:35:cat.0 00000100:00100000:0.0:1790919117.528398:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+14:10322:x1877914532478720:12345-192.168.201.27@tcp:35:cat.0 Request processed in 372us (13428us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1790919117.528408:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 12 00000100:00100000:3.0:1790919117.567892:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790919117.567921:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb0b1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550336768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790919117.567992:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919117.570082:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550336768 00000100:00100000:0.0:1790919117.570096:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550336768 00000100:00100000:0.0:1790919117.570505:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790919117.570754:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be83438700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550336768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790919117.570796:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790919117.570884:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be83438700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550336768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 369us (2890us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919117.570892:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790919117.571077:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb0b1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550336768:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790919117.572292:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790919117.652101:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919117.652681:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532479104 00000100:00100000:1.0:1790919117.652694:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532479104 00000100:00100000:1.0:1790919117.652763:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 51 00000100:00100000:1.0:1790919117.652774:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be83438000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+14:10328:x1877914532479104:12345-192.168.201.27@tcp:101:dd.0 00010000:00010000:1.0:1790919117.652798:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919117.652801:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1790919117.652828:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c45af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc13 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919117.652850:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88be8b621100) 00010000:00010000:1.0:1790919117.652854:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790919117.652868:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c465e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cc44 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919117.652968:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f200/0xc3296956897c4665 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919117.652981:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c462d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc36 expref: 14 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919117.652990:0:5847:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f200/0xc3296956897c4665 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919117.653060:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c462d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc36 expref: 14 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919117.653081:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c462d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc36 expref: 14 pid: 8231 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919117.653096:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beba025c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1877914550336896:192.168.201.27@tcp:104: 00000100:00100000:1.0:1790919117.653199:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bebfbc9540 going to sleep for 11 seconds 00000100:00100000:2.0:1790919117.687138:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beba025c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1877914550336896:192.168.201.27@tcp:104: 00010000:00010000:2.0:1790919117.687191:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f200/0xc3296956897c4665 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919117.691218:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919117.691332:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532479232 00000100:00100000:0.0:1790919117.691350:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532479232 00010000:00010000:0.0:1790919117.691427:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c462d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc36 expref: 15 pid: 8231 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919117.691474:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 38 00000100:00100000:0.0:1790919117.691484:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be83439180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+15:2352:x1877914532479232:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790919117.691503:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919117.691511:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c462d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc36 expref: 15 pid: 8231 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919117.691561:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c462d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc36 expref: 15 pid: 8231 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919117.691622:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c462d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc36 expref: 15 pid: 8231 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919117.691645:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be85efce00) 00010000:00010000:0.0:1790919117.691651:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f200/0xc3296956897c4665 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919117.691663:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f200/0xc3296956897c4665 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919117.691672:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f200/0xc3296956897c4665 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919117.691726:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790919117.691965:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f200/0xc3296956897c4665 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919117.691976:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f200/0xc3296956897c4665 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919117.692012:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1790919117.692219:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c465e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc44 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919117.692241:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f200/0xc3296956897c4665 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc44 expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919117.692249:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be85efce00) 00010000:00010000:2.0:1790919117.692251:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790919117.692254:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88beb3f7f200, rc 0) 00000100:00100000:2.0:1790919117.692305:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be83438000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+15:10328:x1877914532479104:12345-192.168.201.27@tcp:101:dd.0 Request processed in 39532us (40226us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1790919117.692314:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 51 00000100:00100000:0.0:1790919117.692505:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be83439180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+14:2352:x1877914532479232:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 1020us (1296us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919117.692516:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 38 00000100:00100000:1.0:1790919117.696820:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919117.696988:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532479488 00000100:00100000:0.0:1790919117.697006:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532479488 00000100:00100000:0.0:1790919117.697096:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 52 00000100:00100000:0.0:1790919117.697109:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba024e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+14:10328:x1877914532479488:12345-192.168.201.27@tcp:36:dd.0 00010000:00010000:0.0:1790919117.697583:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4673 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919117.697853:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4673 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919117.697870:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4673 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790919117.697965:0:5845:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1790919117.697999:0:5845:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000564dbcc5 reply state 00000000ff19be2f transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4673 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919117.698010:0:5845:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790919117.698158:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba024e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+17:10328:x1877914532479488:12345-192.168.201.27@tcp:36:dd.0 Request processed in 1048us (1355us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1790919117.698169:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 52 00000020:00080000:0.0:1790919117.698175:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790919117.711641:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4673 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919117.711665:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4673 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919117.711674:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4673 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919117.711681:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac59e00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919117.711697:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4673 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919117.711707:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4673 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919117.711756:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be85efce00) 00010000:00010000:2.0:1790919117.711759:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919117.711765:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4673 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919117.711772:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4673 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919118.080446:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919118.181463:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919118.181605:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532479616 00000100:00100000:2.0:1790919118.181626:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532479616 00000100:00100000:2.0:1790919118.181718:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 53 00000100:00100000:2.0:1790919118.181731:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+16:10343:x1877914532479616:12345-192.168.201.27@tcp:101:stat.0 00010000:00010000:2.0:1790919118.181769:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919118.181800:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c467a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cc4b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919118.181912:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c4681 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919118.181932:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c4681 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919118.181948:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c4681 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919118.181966:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4688 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919118.181974:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4688 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919118.182002:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4688 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919118.182415:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c468f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919118.182430:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f200/0xc3296956897c4665 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc44 expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919118.182439:0:5846:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c468f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919118.182482:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f200/0xc3296956897c4665 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc44 expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919118.182499:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f200/0xc3296956897c4665 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc44 expref: 17 pid: 5847 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919118.182515:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb0b1d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877914550337024:192.168.201.27@tcp:104: 00000100:00100000:2.0:1790919118.182714:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bebf6ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1790919118.201831:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919118.202018:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb0b1d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877914550337024:192.168.201.27@tcp:104: 00010000:00010000:2.0:1790919118.202057:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c468f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919118.202139:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532479872 00000100:00100000:3.0:1790919118.202150:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532479872 00000100:00100000:3.0:1790919118.202228:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 13 00000100:00100000:3.0:1790919118.202239:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+18:6048:x1877914532479872:12345-192.168.201.27@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1790919118.202972:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+19:6048:x1877914532479872:12345-192.168.201.27@tcp:35:ldlm_bl.0 Request processed in 730us (1167us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1790919118.202983:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 13 00000100:00100000:3.0:1790919118.206078:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919118.216847:0:8529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532480000 00000100:00100000:1.0:1790919118.216867:0:8529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532480000 00010000:00010000:1.0:1790919118.216942:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f200/0xc3296956897c4665 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc44 expref: 19 pid: 5847 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919118.217011:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 39 00000100:00100000:1.0:1790919118.217025:0:8529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be8343a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+19:2352:x1877914532480000:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790919118.217044:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919118.217051:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f200/0xc3296956897c4665 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc44 expref: 19 pid: 5847 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919118.217067:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f200/0xc3296956897c4665 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc44 expref: 19 pid: 5847 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919118.217094:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f200/0xc3296956897c4665 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc44 expref: 19 pid: 5847 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919118.217118:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be85efce00) 00010000:00010000:1.0:1790919118.217142:0:8529:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c468f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919118.217154:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c468f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919118.217162:0:8529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c468f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919118.217409:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919118.217574:0:8529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be8343a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+18:2352:x1877914532480000:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 504us (11464us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919118.217585:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 39 00010000:00010000:0.0:1790919118.224986:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c468f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.225010:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c468f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919118.225088:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1790919118.225094:0:5846:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790919118.225160:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c468f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.225180:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c468f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.225192:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c4681 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.225201:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c4681 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.225208:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c4681 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.225237:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386e00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919118.225242:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c4681 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.225251:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c4681 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.225270:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88be8b621100) 00010000:00010000:0.0:1790919118.225273:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919118.225278:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c4681 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.225285:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c4681 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.225306:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4688 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.225312:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4688 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.225318:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4688 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.225322:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386200 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919118.225325:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4688 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.225330:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4688 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.225348:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88be85efc700) 00010000:00010000:0.0:1790919118.225351:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919118.225354:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4688 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.225372:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4688 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.225433:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c467a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc4b expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.225448:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c468f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc4b expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.225456:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be85efce00) 00010000:00010000:0.0:1790919118.225458:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790919118.225460:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be88387a00, rc 0) 00000100:00100000:0.0:1790919118.225701:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+17:10343:x1877914532479616:12345-192.168.201.27@tcp:101:stat.0 Request processed in 43970us (44245us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919118.225712:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 53 00000100:00100000:1.0:1790919118.340038:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919118.340197:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532480256 00000100:00100000:0.0:1790919118.340212:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532480256 00000100:00100000:0.0:1790919118.340295:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 54 00000100:00100000:0.0:1790919118.340308:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+17:10349:x1877914532480256:12345-192.168.201.27@tcp:36:truncate.0 00010000:00010000:0.0:1790919118.340403:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919118.340437:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c468f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc4b expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.340487:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be85efce00) 00010000:00010000:0.0:1790919118.340494:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790919118.340841:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c4696 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.340859:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c4696 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.340871:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c4696 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790919118.341194:0:5845:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1790919118.341224:0:5845:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a1358771 reply state 00000000d593c5f0 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c4696 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919118.341235:0:5845:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790919118.341407:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+19:10349:x1877914532480256:12345-192.168.201.27@tcp:36:truncate.0 Request processed in 1099us (1383us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1790919118.341417:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 54 00000020:00080000:0.0:1790919118.341425:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790919118.346216:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c4696 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919118.346239:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c4696 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919118.346268:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c4696 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919118.346275:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac59400 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919118.346282:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c4696 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919118.346292:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c4696 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919118.346313:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be85efce00) 00010000:00010000:2.0:1790919118.346316:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919118.346322:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c4696 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919118.346329:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c4696 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919118.543123:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919118.543182:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919118.543226:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919118.543265:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919118.543387:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532480512 00000100:00100000:3.0:1790919118.543411:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532480512 00000100:00100000:3.0:1790919118.543868:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 287 00000100:00100000:3.0:1790919118.543882:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+13:2350:x1877914532480512:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1790919118.543983:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+13:2350:x1877914532480512:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 104us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919118.543992:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 287 00000100:00100000:0.0:1790919118.544372:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532480640 00000100:00100000:0.0:1790919118.544380:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532480640 00000100:00100000:0.0:1790919118.544453:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 73 00000100:00100000:0.0:1790919118.544462:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba027480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:2350:x1877914532480640:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:0.0:1790919118.544700:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba027480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:2350:x1877914532480640:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 239us (1516us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919118.544707:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 73 00000100:00100000:0.0:1790919118.544734:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532480384 00000100:00100000:0.0:1790919118.544757:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532480384 00000100:00100000:0.0:1790919118.544792:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532480768 00000100:00100000:0.0:1790919118.544795:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532480768 00000100:00100000:0.0:1790919118.544819:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 133 00000100:00100000:0.0:1790919118.544826:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba025500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5591729f-44f1-43f1-b042-c3a508737d97+5:2350:x1877914532480768:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:0.0:1790919118.544859:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba025500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5591729f-44f1-43f1-b042-c3a508737d97+5:2350:x1877914532480768:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 34us (1594us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919118.544866:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 133 00000100:00100000:0.0:1790919118.544879:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 55 00000100:00100000:0.0:1790919118.544886:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+18:10363:x1877914532480384:12345-192.168.201.27@tcp:101:stat.0 00010000:00010000:0.0:1790919118.544905:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919118.544931:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c469d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cc52 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.545012:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c46a4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.545031:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c46a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.545045:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c46a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.545061:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c46ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.545067:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c46ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.545073:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c46ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1790919118.546056:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790919118.546065:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1790919118.546598:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c46b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.547160:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c46b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.547182:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c46b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919118.547252:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1790919118.547259:0:5846:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790919118.547290:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c46b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.547307:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c46b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.547318:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c46a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.547327:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c46a4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.548894:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c46a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.548904:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac58a00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919118.548910:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c46a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.548920:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c46a4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.548961:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88be8b621100) 00010000:00010000:0.0:1790919118.548964:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919118.548972:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c46a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.548980:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c46a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.549003:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c46ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.549010:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c46ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.549017:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c46ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.549023:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac58200 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919118.549026:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c46ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.549033:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c46ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.549041:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88be853b5f00) 00010000:00010000:0.0:1790919118.549776:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919118.549790:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c46ab lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.549799:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c46ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.549897:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c469d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc52 expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.549915:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c46b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc52 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.549925:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be85efce00) 00010000:00010000:0.0:1790919118.549927:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790919118.549931:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac58000, rc 0) 00000100:00100000:0.0:1790919118.550064:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+19:10363:x1877914532480384:12345-192.168.201.27@tcp:101:stat.0 Request processed in 5176us (6966us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919118.550077:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 55 00000100:00100000:3.0:1790919118.658700:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919118.660802:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532481024 00000100:00100000:1.0:1790919118.660825:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532481024 00000100:00100000:1.0:1790919118.660933:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 56 00000100:00100000:1.0:1790919118.660946:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be8343b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+19:10373:x1877914532481024:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:1.0:1790919118.660973:0:8231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919118.661002:0:8231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f200/0xc3296956897c46b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cc59 expref: -99 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790919118.661130:0:8231:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1790919118.661305:0:8231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f200/0xc3296956897c46b9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc59 expref: 21 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919118.661346:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be88e22e00) 00010000:00010000:1.0:1790919118.661349:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790919118.661364:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f200/0xc3296956897c46b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc59 expref: 21 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919118.661386:0:8231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88beb3f7f200, rc 0) 00000100:00100000:1.0:1790919118.663359:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be8343b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+20:10373:x1877914532481024:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 2393us (4649us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1790919118.663375:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 56 00000100:00100000:2.0:1790919118.680304:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919118.680509:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532481280 00000100:00100000:0.0:1790919118.680523:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532481280 00000100:00100000:0.0:1790919118.680649:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 14 00000100:00100000:0.0:1790919118.680661:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+20:10373:x1877914532481280:12345-192.168.201.27@tcp:35:lfs.0 00000100:00100000:0.0:1790919118.681003:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+21:10373:x1877914532481280:12345-192.168.201.27@tcp:35:lfs.0 Request processed in 342us (713us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1790919118.681012:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 14 00000100:00100000:3.0:1790919118.775910:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919118.776649:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532481536 00000100:00100000:1.0:1790919118.776661:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532481536 00000100:00100000:1.0:1790919118.776731:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 57 00000100:00100000:1.0:1790919118.776741:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be8343bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+21:10379:x1877914532481536:12345-192.168.201.27@tcp:101:bash.0 00010000:00010000:1.0:1790919118.776766:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919118.776787:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ec00/0xc3296956897c46c7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cc60 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919118.776888:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f800/0xc3296956897c46ce lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919118.776903:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c46b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc52 expref: 22 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919118.776911:0:5847:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f800/0xc3296956897c46ce lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919118.776944:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c46b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc52 expref: 22 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919118.776978:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c46b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc52 expref: 22 pid: 5846 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919118.776993:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beba027800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1877914550337152:192.168.201.27@tcp:104: 00000100:00100000:1.0:1790919118.777338:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bebfbc9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790919118.787112:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beba027800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1877914550337152:192.168.201.27@tcp:104: 00010000:00010000:2.0:1790919118.787157:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f800/0xc3296956897c46ce lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919118.787497:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919118.787765:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532481664 00000100:00100000:0.0:1790919118.787776:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532481664 00010000:00010000:0.0:1790919118.787819:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c46b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc52 expref: 23 pid: 5846 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919118.787856:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 40 00000100:00100000:0.0:1790919118.787865:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be83438380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+23:2353:x1877914532481664:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790919118.787894:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919118.787901:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c46b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc52 expref: 23 pid: 5846 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.787913:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c46b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc52 expref: 23 pid: 5846 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.787933:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c46b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc52 expref: 23 pid: 5846 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.787949:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be85efce00) 00010000:00010000:0.0:1790919118.787953:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f800/0xc3296956897c46ce lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.787963:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f800/0xc3296956897c46ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.787970:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f800/0xc3296956897c46ce lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.788000:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790919118.788049:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f800/0xc3296956897c46ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919118.788060:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be83438380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+22:2353:x1877914532481664:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 195us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919118.788070:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 40 00010000:00010000:2.0:1790919118.788084:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f800/0xc3296956897c46ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919118.788115:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1790919118.788760:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ec00/0xc3296956897c46c7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc60 expref: 23 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919118.788794:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f800/0xc3296956897c46ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc60 expref: 22 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919118.788804:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be85efce00) 00010000:00010000:2.0:1790919118.788807:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790919118.788811:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88beb3f7f800, rc 0) 00000100:00100000:2.0:1790919118.788897:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be8343bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+22:10379:x1877914532481536:12345-192.168.201.27@tcp:101:bash.0 Request processed in 12156us (12996us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1790919118.788908:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 57 00000100:00100000:1.0:1790919118.802690:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919118.802768:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532481920 00000100:00100000:0.0:1790919118.802780:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532481920 00000100:00100000:0.0:1790919118.802893:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 58 00000100:00100000:0.0:1790919118.802905:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+22:10379:x1877914532481920:12345-192.168.201.27@tcp:36:bash.0 00010000:00010000:0.0:1790919118.803196:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c46dc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.803215:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c46dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.803226:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c46dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790919118.803300:0:5845:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1790919118.803336:0:5845:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000334f7507 reply state 00000000c044ab48 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c46dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919118.803343:0:5845:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790919118.803461:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+25:10379:x1877914532481920:12345-192.168.201.27@tcp:36:bash.0 Request processed in 557us (779us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1790919118.803468:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 58 00000020:00080000:0.0:1790919118.803474:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790919118.805470:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c46dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919118.805495:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c46dc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919118.805504:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c46dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919118.805512:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac58000 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919118.805518:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c46dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919118.805577:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c46dc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919118.805599:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be85efce00) 00010000:00010000:2.0:1790919118.805602:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919118.805632:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c46dc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919118.805639:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c46dc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919118.812228:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919118.812449:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532482048 00000100:00100000:0.0:1790919118.812469:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532482048 00000100:00100000:0.0:1790919118.812559:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 59 00000100:00100000:0.0:1790919118.812571:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba024700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+24:10379:x1877914532482048:12345-192.168.201.27@tcp:101:bash.0 00010000:00010000:0.0:1790919118.812594:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919118.812617:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c46e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cc67 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.812698:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c46ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.812714:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f800/0xc3296956897c46ce lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc60 expref: 25 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.812735:0:5846:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c46ea lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.812772:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f800/0xc3296956897c46ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc60 expref: 25 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.812788:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f800/0xc3296956897c46ce lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc60 expref: 25 pid: 5847 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919118.812803:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac3e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877914550337280:192.168.201.27@tcp:104: 00000100:00100000:0.0:1790919118.812889:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be85e0d540 going to sleep for 11 seconds 00000100:00100000:0.0:1790919118.819606:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac3e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877914550337280:192.168.201.27@tcp:104: 00010000:00010000:0.0:1790919118.819635:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c46ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919118.825083:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919118.825320:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532482176 00000100:00100000:3.0:1790919118.825331:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532482176 00010000:00010000:3.0:1790919118.825388:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f800/0xc3296956897c46ce lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc60 expref: 26 pid: 5847 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919118.825435:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 41 00000100:00100000:3.0:1790919118.825446:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba024000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+26:2353:x1877914532482176:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919118.825461:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919118.825468:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f800/0xc3296956897c46ce lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc60 expref: 26 pid: 5847 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919118.825481:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f800/0xc3296956897c46ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc60 expref: 26 pid: 5847 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919118.825504:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f800/0xc3296956897c46ce lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc60 expref: 26 pid: 5847 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919118.825596:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be85efce00) 00010000:00010000:3.0:1790919118.825601:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c46ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919118.825611:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c46ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919118.825619:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c46ea lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919118.825643:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919118.825708:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba024000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+25:2353:x1877914532482176:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 263us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919118.825716:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 41 00010000:00010000:0.0:1790919118.826590:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c46ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.826602:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c46ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919118.826650:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1790919118.826656:0:5846:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790919118.826677:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c46ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.826713:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c46e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc67 expref: 25 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.826747:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c46ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc67 expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919118.826755:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be85efce00) 00010000:00010000:0.0:1790919118.826757:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790919118.826761:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac58200, rc 0) 00000100:00100000:0.0:1790919118.826812:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba024700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+24:10379:x1877914532482048:12345-192.168.201.27@tcp:101:bash.0 Request processed in 14243us (14594us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919118.826820:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 59 00000100:00100000:1.0:1790919118.834289:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919118.834378:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532482432 00000100:00100000:0.0:1790919118.834388:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532482432 00000100:00100000:0.0:1790919118.834449:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 15 00000100:00100000:0.0:1790919118.834459:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be92909850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+24:10379:x1877914532482432:12345-192.168.201.27@tcp:35:bash.0 00000100:00100000:0.0:1790919118.834755:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be92909850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+25:10379:x1877914532482432:12345-192.168.201.27@tcp:35:bash.0 Request processed in 296us (475us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1790919118.834763:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 15 00000100:00100000:3.0:1790919118.960994:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919118.961192:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532482688 00000100:00100000:1.0:1790919118.961202:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532482688 00000100:00100000:1.0:1790919118.961268:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 60 00000100:00100000:1.0:1790919118.961278:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be8343aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+25:10389:x1877914532482688:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:1.0:1790919118.961303:0:8231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919118.961324:0:8231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e400/0xc3296956897c46f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cc6e expref: -99 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790919118.961427:0:8231:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1790919118.961604:0:8231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e400/0xc3296956897c46f1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc6e expref: 27 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919118.961620:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be88e22e00) 00010000:00010000:1.0:1790919118.961623:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790919118.961629:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e400/0xc3296956897c46f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc6e expref: 27 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919118.961663:0:8231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88beb3f7e400, rc 0) 00000100:00100000:1.0:1790919118.961730:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be8343aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+26:10389:x1877914532482688:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 452us (744us total) trans 4294967345 rc 301/301 00000100:00100000:1.0:1790919118.961739:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 60 00000100:00100000:2.0:1790919118.965687:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919118.967089:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532482816 00000100:00100000:1.0:1790919118.967118:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532482816 00000100:00100000:1.0:1790919118.967200:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 61 00000100:00100000:1.0:1790919118.967212:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+26:10389:x1877914532482816:12345-192.168.201.27@tcp:34:lfs.0 00010000:00010000:1.0:1790919118.967292:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c46ff lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919118.967309:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c46ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919118.967320:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c46ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919118.967336:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7fc00/0xc3296956897c4706 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919118.967343:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7fc00/0xc3296956897c4706 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919118.967366:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7fc00/0xc3296956897c4706 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919118.968167:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c470d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919118.968191:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c470d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919118.968200:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c470d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790919118.968249:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c470d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919118.968262:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c46ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919118.968268:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c46ff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919118.968275:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c46ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919118.968282:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88beb3f7e600 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:1.0:1790919118.968286:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c46ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919118.968293:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c46ff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919118.968304:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88be8b621100) 00010000:00010000:1.0:1790919118.968308:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919118.968312:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c46ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919118.968319:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c46ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919118.968342:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7fc00/0xc3296956897c4706 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919118.968360:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7fc00/0xc3296956897c4706 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919118.968367:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7fc00/0xc3296956897c4706 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919118.968372:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88beb3f7fc00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:1.0:1790919118.968375:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7fc00/0xc3296956897c4706 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919118.968380:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7fc00/0xc3296956897c4706 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919118.968387:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88be8b621300) 00010000:00010000:1.0:1790919118.968390:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919118.968393:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7fc00/0xc3296956897c4706 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919118.968398:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7fc00/0xc3296956897c4706 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919118.968416:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c470d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919118.968422:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c470d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919118.968427:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c470d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919118.968439:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88beb3f7e800 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:1.0:1790919118.968442:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c470d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919118.968448:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c470d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919118.968456:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be85efce00) 00010000:00010000:1.0:1790919118.968458:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919118.969038:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c470d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919118.969811:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c470d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919118.969996:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+26:10389:x1877914532482816:12345-192.168.201.27@tcp:34:lfs.0 Request processed in 2782us (4321us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919118.970007:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 61 00000100:00100000:3.0:1790919118.988087:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919118.988238:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532483072 00000100:00100000:0.0:1790919118.988248:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532483072 00000100:00100000:0.0:1790919118.988318:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 16 00000100:00100000:0.0:1790919118.988329:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be83439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+26:10389:x1877914532483072:12345-192.168.201.27@tcp:35:lfs.0 00000100:00100000:0.0:1790919118.988617:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be83439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+27:10389:x1877914532483072:12345-192.168.201.27@tcp:35:lfs.0 Request processed in 289us (539us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1790919118.988625:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 16 00000040:00080000:1.0:1790919119.040909:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1790919119.100505:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919119.100637:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532483328 00000100:00100000:1.0:1790919119.100649:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532483328 00000100:00100000:1.0:1790919119.100731:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 62 00000100:00100000:1.0:1790919119.100742:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be83438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+27:10392:x1877914532483328:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:1.0:1790919119.100768:0:8231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919119.100791:0:8231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c4714 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cc75 expref: -99 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919119.100870:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7fc00/0xc3296956897c471b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919119.100898:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7fc00/0xc3296956897c471b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919119.100910:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7fc00/0xc3296956897c471b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919119.100925:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c4722 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919119.100931:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c4722 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919119.100937:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c4722 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919119.101387:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e400/0xc3296956897c4729 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919119.101398:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e400/0xc3296956897c4729 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919119.101405:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e400/0xc3296956897c4729 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790919119.101415:0:8231:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000100:00080000:3.0:1790919119.101564:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790919119.101667:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7fc00/0xc3296956897c471b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919119.101675:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7fc00/0xc3296956897c471b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919119.101683:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7fc00/0xc3296956897c471b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919119.101695:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88beb3f7fc00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:1.0:1790919119.101700:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7fc00/0xc3296956897c471b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919119.101708:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7fc00/0xc3296956897c471b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919119.101720:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88be8b621100) 00010000:00010000:1.0:1790919119.101723:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919119.101729:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7fc00/0xc3296956897c471b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919119.101735:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7fc00/0xc3296956897c471b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919119.101749:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c4722 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919119.101755:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c4722 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919119.101760:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c4722 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919119.101765:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88beb3f7e600 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:1.0:1790919119.101767:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c4722 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919119.101773:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c4722 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919119.101794:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88be8b621300) 00010000:00010000:1.0:1790919119.101796:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919119.101799:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c4722 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919119.101805:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c4722 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919119.101852:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c4714 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc75 expref: 30 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919119.101865:0:8231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e400/0xc3296956897c4729 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc75 expref: 29 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919119.101871:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be85efce00) 00010000:00010000:1.0:1790919119.101873:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790919119.101876:0:8231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88beb3f7e400, rc 0) 00000100:00100000:1.0:1790919119.101982:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be83438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+29:10392:x1877914532483328:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 1241us (1497us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1790919119.101991:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 62 00010000:00010000:2.0:1790919119.103843:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919119.123999:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919119.124065:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919119.124184:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532483584 00000100:00100000:3.0:1790919119.124195:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532483584 00000100:00100000:3.0:1790919119.124266:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 4 00000100:00100000:3.0:1790919119.124277:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+29:2350:x1877914532483584:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919119.124293:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919119.124319:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e400/0xc3296956897c4729 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc75 expref: 29 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919119.124340:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be85efce00) 00010000:00010000:3.0:1790919119.124369:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919119.124422:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+28:2350:x1877914532483584:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 146us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919119.124429:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 4 00000100:00100000:0.0:1790919119.125926:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532483456 00000100:00100000:0.0:1790919119.125955:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532483456 00000100:00100000:0.0:1790919119.126023:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 63 00000100:00100000:0.0:1790919119.126032:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+28:10392:x1877914532483456:12345-192.168.201.27@tcp:54:lfs.0 00010000:00010000:0.0:1790919119.126318:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4737 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919119.126335:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4737 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919119.126359:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4737 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919119.126387:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4737 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919119.126395:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4737 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919119.126402:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4737 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919119.126408:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac59000 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919119.126413:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4737 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919119.126421:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4737 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919119.126432:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be85efce00) 00010000:00010000:0.0:1790919119.126435:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790919119.126439:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4737 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919119.126456:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4737 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919119.126790:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+28:10392:x1877914532483456:12345-192.168.201.27@tcp:54:lfs.0 Request processed in 758us (2801us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919119.126798:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 63 00000100:00100000:2.0:1790919119.143766:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919119.143841:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532483840 00000100:00100000:0.0:1790919119.143852:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532483840 00000100:00100000:0.0:1790919119.143906:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 17 00000100:00100000:0.0:1790919119.143917:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+28:10392:x1877914532483840:12345-192.168.201.27@tcp:35:lfs.0 00000100:00100000:0.0:1790919119.144188:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+29:10392:x1877914532483840:12345-192.168.201.27@tcp:35:lfs.0 Request processed in 272us (430us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1790919119.144197:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 17 00000100:00100000:2.0:1790919119.323037:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919119.323153:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532484096 00000100:00100000:0.0:1790919119.323166:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532484096 00000100:00100000:0.0:1790919119.323224:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 64 00000100:00100000:0.0:1790919119.323233:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+29:10410:x1877914532484096:12345-192.168.201.27@tcp:101:cat.0 00010000:00010000:0.0:1790919119.323259:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919119.323279:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c473e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cc7c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919119.323425:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c4745 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919119.323441:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c4745 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919119.323471:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c4745 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919119.323483:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1790919119.323663:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c473e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc7c expref: 32 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919119.323683:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c4745 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc7c expref: 31 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919119.323693:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be85efce00) 00010000:00010000:0.0:1790919119.323696:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1790919119.323700:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac58a00, rc 0) 00000100:00100000:0.0:1790919119.323762:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+31:10410:x1877914532484096:12345-192.168.201.27@tcp:101:cat.0 Request processed in 529us (735us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1790919119.323770:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 64 00000100:00100000:2.0:1790919119.343802:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919119.343998:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532484224 00000100:00100000:1.0:1790919119.344009:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532484224 00000100:00100000:1.0:1790919119.344080:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 65 00000100:00100000:1.0:1790919119.344098:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+31:10411:x1877914532484224:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:1.0:1790919119.344123:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919119.344144:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c4753 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cc83 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919119.344233:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c475a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919119.344246:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c475a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919119.344257:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c475a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790919119.344290:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1790919119.344293:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790919119.344311:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c475a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919119.344337:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c4753 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc83 expref: 33 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919119.344368:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c475a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc83 expref: 32 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919119.344377:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88be8b621100) 00010000:00010000:1.0:1790919119.344379:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790919119.344382:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88beb3f7e600, rc 0) 00000100:00100000:1.0:1790919119.344445:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+32:10411:x1877914532484224:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 358us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919119.344453:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 65 00000100:00100000:2.0:1790919119.373314:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919119.373425:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532484608 00000100:00100000:0.0:1790919119.373437:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532484608 00000100:00100000:0.0:1790919119.373500:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 18 00000100:00100000:0.0:1790919119.373510:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+32:10411:x1877914532484608:12345-192.168.201.27@tcp:35:lfs.0 00000100:00100000:0.0:1790919119.374033:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+33:10411:x1877914532484608:12345-192.168.201.27@tcp:35:lfs.0 Request processed in 523us (727us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1790919119.374041:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 18 00000100:00100000:2.0:1790919119.396023:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919119.396120:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532484736 00000100:00100000:3.0:1790919119.396131:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532484736 00000100:00100000:3.0:1790919119.396205:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 5 00000100:00100000:3.0:1790919119.396216:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+33:10411:x1877914532484736:12345-192.168.201.27@tcp:103:lfs.0 00010000:00010000:3.0:1790919119.396233:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1790919119.396259:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c46ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc67 expref: 33 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919119.396294:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c4745 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc7c expref: 32 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919119.396308:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c45ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc28 expref: 31 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919119.396320:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be85efce00) 00010000:00010000:3.0:1790919119.396336:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919119.396403:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+30:10411:x1877914532484736:12345-192.168.201.27@tcp:103:lfs.0 Request processed in 189us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919119.396411:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 5 00000100:00100000:2.0:1790919119.400786:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919119.400925:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532484864 00000100:00100000:3.0:1790919119.400935:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532484864 00000100:00100000:3.0:1790919119.400989:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 66 00000100:00100000:3.0:1790919119.401000:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+30:10411:x1877914532484864:12345-192.168.201.27@tcp:58:lfs.0 00010000:00010000:3.0:1790919119.401140:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4761 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919119.401156:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4761 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919119.401167:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4761 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790919119.402599:0:8231:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790919119.420991:0:8231:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1790919119.421095:0:8231:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1790919119.421231:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+30:10411:x1877914532484864:12345-192.168.201.27@tcp:58:lfs.0 Request processed in 20228us (20458us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919119.421244:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 66 00000100:00100000:0.0:1790919119.469075:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919119.469336:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532484992 00000100:00100000:1.0:1790919119.469359:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532484992 00000100:00100000:1.0:1790919119.469436:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 67 00000100:00100000:1.0:1790919119.469445:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+30:10413:x1877914532484992:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:1.0:1790919119.469465:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919119.469487:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c4768 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cc8a expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919119.478985:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c476f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919119.479011:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c476f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919119.479023:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c476f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919119.479045:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4776 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919119.479053:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4776 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919119.479059:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4776 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919119.479336:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c477d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919119.479361:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c477d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919119.479369:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c477d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919119.479409:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1790919119.479415:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790919119.479433:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c477d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919119.479444:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c477d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919119.479451:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c476f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919119.479458:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c476f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919119.479464:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c476f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919119.479469:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386200 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919119.479473:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c476f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919119.479480:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c476f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919119.479502:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88be8b621100) 00010000:00010000:2.0:1790919119.479504:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919119.479509:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c476f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919119.479547:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c476f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919119.479561:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4776 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919119.479567:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4776 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919119.479572:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4776 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919119.479576:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88387400 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919119.479902:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4776 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919119.479914:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4776 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919119.479923:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88be85efc900) 00010000:00010000:2.0:1790919119.479926:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919119.479929:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4776 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919119.479934:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4776 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919119.479988:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c4768 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc8a expref: 32 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919119.480006:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c477d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc8a expref: 31 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919119.480013:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be88e22300) 00010000:00010000:2.0:1790919119.480016:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790919119.480018:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be88387a00, rc 0) 00000100:00100000:2.0:1790919119.480102:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+31:10413:x1877914532484992:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 10656us (11036us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919119.480111:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 67 00000040:00080000:1.0:1790919120.063712:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790919120.063722:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790919120.063857:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1790919120.063866:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790919120.063988:0:11708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beba025180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11708:1877914550337408:192.168.201.27@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790919120.064163:0:11708:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bebfbc9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790919120.071161:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919120.071293:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532485120 00000100:00100000:3.0:1790919120.071303:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532485120 00000100:00100000:1.0:1790919120.071360:0:11708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beba025180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11708:1877914550337408:192.168.201.27@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790919120.071364:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 1 00000100:00100000:3.0:1790919120.071373:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+32:10424:x1877914532485120:12345-192.168.201.27@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1790919120.071460:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+31:10424:x1877914532485120:12345-192.168.201.27@tcp:900:lhsmtool_posix.0 Request processed in 88us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919120.071467:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 1 00000100:00100000:2.0:1790919120.073709:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919120.073850:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532485248 00000100:00100000:1.0:1790919120.073859:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532485248 00000100:00100000:1.0:1790919120.073915:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 68 00000100:00100000:1.0:1790919120.073925:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+31:10424:x1877914532485248:12345-192.168.201.27@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790919120.073956:0:5845:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790919120.074069:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+31:10424:x1877914532485248:12345-192.168.201.27@tcp:53:lhsmtool_posix.0 Request processed in 144us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919120.074077:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 68 00000100:00100000:3.0:1790919120.091701:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919120.093487:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532485376 00000100:00100000:0.0:1790919120.093502:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532485376 00000100:00100000:0.0:1790919120.093590:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 69 00000100:00100000:0.0:1790919120.093602:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be83439880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+31:10424:x1877914532485376:12345-192.168.201.27@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1790919120.093675:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4784 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.093693:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4784 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.093704:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4784 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.093718:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58400/0xc3296956897c478b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.093726:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58400/0xc3296956897c478b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.093732:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58400/0xc3296956897c478b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.093759:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c4792 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.093768:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c4792 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.093774:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c4792 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919120.093811:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1790919120.093816:0:5846:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790919120.093833:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c4792 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.093851:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4784 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.093858:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4784 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.093865:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4784 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.093871:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac59a00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919120.093876:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4784 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.093883:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4784 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.093894:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88be85efcb00) 00010000:00010000:0.0:1790919120.093897:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919120.093901:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4784 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.093906:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4784 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.093918:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58400/0xc3296956897c478b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.093924:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58400/0xc3296956897c478b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.093930:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58400/0xc3296956897c478b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.093942:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac58400 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919120.093945:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58400/0xc3296956897c478b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.093952:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58400/0xc3296956897c478b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.093960:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff88be853b5f00) 00010000:00010000:0.0:1790919120.093962:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919120.093965:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58400/0xc3296956897c478b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.093970:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58400/0xc3296956897c478b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.093985:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c4792 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.093991:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c4792 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.093997:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c4792 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.094002:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac59200 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919120.094004:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c4792 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.094009:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c4792 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.094027:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be88e22300) 00010000:00010000:0.0:1790919120.094029:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919120.094032:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c4792 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.094037:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c4792 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919120.094111:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be83439880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+31:10424:x1877914532485376:12345-192.168.201.27@tcp:34:lhsmtool_posix.0 Request processed in 512us (2418us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919120.094120:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 69 00000100:00100000:3.0:1790919120.098826:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919120.098863:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532485632 00000100:00100000:3.0:1790919120.098874:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532485632 00000100:00100000:3.0:1790919120.098924:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 70 00000100:00100000:3.0:1790919120.098935:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be8343ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+31:10424:x1877914532485632:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790919120.098969:0:8231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919120.098993:0:8231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4799 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cc91 expref: -99 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919120.099160:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c47a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919120.099178:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c47a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919120.099191:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c47a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919120.099205:0:8231:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1790919120.099303:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c47a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919120.099311:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c47a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919120.099318:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c47a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919120.099324:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81673800 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919120.099678:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c47a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919120.099689:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c47a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919120.099703:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be88e22300) 00010000:00010000:3.0:1790919120.099714:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790919120.099720:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c47a0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919120.099727:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c47a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919120.099775:0:8231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4799 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc91 expref: 33 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919120.099785:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88be85efcb00) 00010000:00010000:3.0:1790919120.099787:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790919120.099791:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4799 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc91 expref: 33 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919120.099801:0:8231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81673200, rc 0) 00000100:00100000:3.0:1790919120.099901:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be8343ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+32:10424:x1877914532485632:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 967us (1083us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1790919120.099910:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 70 00000100:00100000:2.0:1790919120.118893:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919120.118951:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532485760 00000100:00100000:0.0:1790919120.118959:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532485760 00000100:00100000:0.0:1790919120.119005:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 71 00000100:00100000:0.0:1790919120.119012:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+32:10424:x1877914532485760:12345-192.168.201.27@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790919120.119041:0:5846:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790919120.119161:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+32:10424:x1877914532485760:12345-192.168.201.27@tcp:53:lhsmtool_posix.0 Request processed in 148us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919120.119169:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 71 00000100:00100000:1.0:1790919120.122039:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919120.122122:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532486016 00000100:00100000:2.0:1790919120.122130:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532486016 00000100:00100000:2.0:1790919120.122177:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 72 00000100:00100000:2.0:1790919120.122183:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba025180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+32:10424:x1877914532486016:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790919120.122201:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919120.122203:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1790919120.122226:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c475a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc83 expref: 32 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.122243:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88be8b621100) 00010000:00010000:2.0:1790919120.122247:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790919120.122270:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c47ae lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cc98 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790919120.122874:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1790919120.123057:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c47b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.123072:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c47b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.123083:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c47b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.123136:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c47ae lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc98 expref: 34 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.123150:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c47b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc98 expref: 33 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.123157:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88be85efc900) 00010000:00010000:2.0:1790919120.123159:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790919120.123161:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be88386600, rc 0) 00000100:00100000:2.0:1790919120.123217:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba025180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+33:10424:x1877914532486016:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 1032us (1184us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1790919120.123224:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 72 00010000:00010000:1.0:1790919120.127673:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919120.128081:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1877914550337792:0@lo:400:kworker.0 00000100:00100000:3.0:1790919120.128157:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919120.128206:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790919120.128212:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550337920:0@lo:400:kworker.0 00000100:00100000:3.0:1790919120.128237:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919120.128267:0:10350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550337920 00000100:00100000:3.0:1790919120.128273:0:10350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550337920 00000100:00100000:3.0:1790919120.128314:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790919120.128320:0:10350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4265f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550337920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919120.128395:0:10350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4265f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550337920:12345-0@lo:400:kworker.0 Request processed in 74us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919120.128403:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1790919120.128426:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790919120.128458:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550337920:0@lo:400:kworker.0 00000100:00100000:0.0:1790919120.128555:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919120.128750:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877914550337664:0@lo:400:kworker.0 00000100:00100000:2.0:1790919120.128780:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919120.128810:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb4266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550338176:0@lo:400:kworker.0 00000100:00100000:2.0:1790919120.128831:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919120.128865:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1790919120.128870:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be83438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3306:1877914550337536:0@lo:400:kworker.0 00000100:00100000:2.0:1790919120.128900:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919120.128922:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1877914550338048:0@lo:400:kworker.0 00000100:00100000:2.0:1790919120.128942:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919120.128964:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550338176 00000100:00100000:2.0:1790919120.128967:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550338176 00000100:00100000:2.0:1790919120.128995:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790919120.129001:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1877914550338176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919120.129030:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1877914550338176:12345-0@lo:400:kworker.0 Request processed in 30us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919120.129036:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790919120.129053:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550337536 00000100:00100000:2.0:1790919120.129056:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550337536 00000100:00100000:2.0:1790919120.129080:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1790919120.129087:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3306:x1877914550337536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919120.129114:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3306:x1877914550337536:12345-0@lo:400:kworker.0 Request processed in 28us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919120.129125:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1790919120.129157:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550337792 00000100:00100000:2.0:1790919120.129160:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550337792 00000100:00100000:2.0:1790919120.129178:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532486272 00000100:00100000:2.0:1790919120.129181:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532486272 00000100:00100000:2.0:1790919120.129193:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550337664 00000100:00100000:2.0:1790919120.129195:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550337664 00000100:00100000:2.0:1790919120.129205:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550338048 00000100:00100000:2.0:1790919120.129207:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550338048 00000100:00100000:2.0:1790919120.129220:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1790919120.129225:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877914550337792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919120.129259:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877914550337792:12345-0@lo:400:kworker.0 Request processed in 34us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919120.129265:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1790919120.129275:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1790919120.129280:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877914550337664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919120.129299:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877914550337664:12345-0@lo:400:kworker.0 Request processed in 19us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919120.129304:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1790919120.129311:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1790919120.129316:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be85f39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877914550338048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919120.129350:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be85f39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877914550338048:12345-0@lo:400:kworker.0 Request processed in 33us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919120.129355:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1790919120.129367:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 73 00000100:00100000:2.0:1790919120.129374:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+33:10424:x1877914532486272:12345-192.168.201.27@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790919120.129420:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919120.129444:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c47b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc98 expref: 33 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.129463:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88be85efc900) 00010000:00010000:2.0:1790919120.129485:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790919120.129507:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c47c3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.129519:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c47c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.129564:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c47c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.129579:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c47ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xe39cb592 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.129586:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c47ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe39cb592 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.129593:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c47ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe39cb592 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.129775:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c47c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.129783:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c47c3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.129790:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c47c3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.129796:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88387c00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919120.129800:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c47c3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.129807:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c47c3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.129815:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88be8b621100) 00010000:00010000:2.0:1790919120.129818:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919120.129822:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c47c3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.129834:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c47c3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.129844:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c47ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe39cb592 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.129850:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c47ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe39cb592 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.129856:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c47ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe39cb592 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.129862:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386c00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919120.129865:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c47ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe39cb592 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.129871:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c47ca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe39cb592 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.129878:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xe39cb592 (ffff88be85efc000) 00010000:00010000:2.0:1790919120.129881:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919120.129884:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c47ca lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xe39cb592 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.129890:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c47ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xe39cb592 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919120.129948:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+32:10424:x1877914532486272:12345-192.168.201.27@tcp:36:lhsmtool_posix.0 Request processed in 574us (1396us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790919120.129954:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 73 00000100:00080000:2.0:1790919120.129977:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790919120.129980:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790919120.130003:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be83438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3306:1877914550337536:0@lo:400:kworker.0 00000100:00100000:2.0:1790919120.130014:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1877914550338048:0@lo:400:kworker.0 00000100:00100000:2.0:1790919120.130022:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877914550337664:0@lo:400:kworker.0 00000100:00100000:2.0:1790919120.130030:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb4266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550338176:0@lo:400:kworker.0 00000100:00100000:3.0:1790919120.130693:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1877914550337792:0@lo:400:kworker.0 00000100:00100000:1.0:1790919120.131912:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919120.131969:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532486400 00000100:00100000:2.0:1790919120.131975:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532486400 00000100:00100000:2.0:1790919120.132016:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 74 00000100:00100000:2.0:1790919120.132022:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+32:10424:x1877914532486400:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790919120.132037:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919120.132056:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c47d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cc9f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.132097:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c47d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.132110:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c47d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.132120:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c47d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.132215:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c47d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc9f expref: 34 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.132230:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c47d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc9f expref: 33 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.132245:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88be85efc500) 00010000:00010000:2.0:1790919120.132248:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790919120.132251:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be88387400, rc 0) 00000100:00100000:2.0:1790919120.132346:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+33:10424:x1877914532486400:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 322us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919120.132354:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 74 00000100:00100000:2.0:1790919120.135662:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919120.135734:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532486656 00000100:00100000:0.0:1790919120.135742:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532486656 00000100:00100000:0.0:1790919120.135837:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 75 00000100:00100000:0.0:1790919120.135845:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be85f3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+33:10424:x1877914532486656:12345-192.168.201.27@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790919120.135912:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58400/0xc3296956897c47df lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.135940:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58400/0xc3296956897c47df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.135948:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58400/0xc3296956897c47df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790919120.136187:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:0.0:1790919120.136194:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 322024666763ns, next at 323024665118ns, rc = 0 00000004:00010000:0.0:1790919120.136250:0:5845:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001e9cca91 reply state 00000000b383a19d transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58400/0xc3296956897c47df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919120.136257:0:5845:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790919120.136348:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be85f3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+35:10424:x1877914532486656:12345-192.168.201.27@tcp:36:lhsmtool_posix.0 Request processed in 504us (693us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1790919120.136355:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 75 00000100:00100000:1.0:1790919120.138351:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919120.138423:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532486784 00000100:00100000:3.0:1790919120.138431:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532486784 00000100:00100000:3.0:1790919120.138574:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 76 00000100:00100000:3.0:1790919120.138582:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+35:10424:x1877914532486784:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790919120.138603:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919120.138617:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c47e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cca6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919120.138661:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c47e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cca6 expref: 36 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919120.138670:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c47e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cca6 expref: 36 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919120.138683:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88be85efc500) 00010000:00010000:3.0:1790919120.138685:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790919120.138687:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81673200, rc 0) 00000100:00100000:3.0:1790919120.138723:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+36:10424:x1877914532486784:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 144us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919120.138728:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 76 00000100:00100000:3.0:1790919120.140840:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00010000:00010000:2.0:1790919120.140923:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58400/0xc3296956897c47df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.140933:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58400/0xc3296956897c47df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.140938:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58400/0xc3296956897c47df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.140942:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac58400 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919120.140946:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58400/0xc3296956897c47df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.140951:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58400/0xc3296956897c47df lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.140963:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88be85efc500) 00010000:00010000:2.0:1790919120.140965:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790919120.140968:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58400/0xc3296956897c47df lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.140972:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58400/0xc3296956897c47df lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919120.141161:0:10350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532486912 00000100:00100000:1.0:1790919120.141177:0:10350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532486912 00000100:00100000:1.0:1790919120.141240:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 25 00000100:00100000:1.0:1790919120.141246:0:10350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2349:x1877914532486912:12345-192.168.201.27@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1790919120.141278:0:10350:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from c4a4e085-55d7-40e9-993c-11b4dfc2d5f5@192.168.201.27@tcp t0 exp 0000000000000000 cur 322 last 0 00000020:00000080:1.0:1790919120.141309:0:10350:0:(genops.c:1384:class_connect()) connect: client c4a4e085-55d7-40e9-993c-11b4dfc2d5f5, cookie 0xc3296956897c47ed 00002000:00100000:1.0:1790919120.141321:0:10350:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c4a4e085-55d7-40e9-993c-11b4dfc2d5f5/ffff88be88dd8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790919120.141354:0:10350:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790919120.141645:0:10350:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1790919120.141674:0:10350:0:(import.c:65:import_set_state_nolock()) ffff88be87131800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790919120.141738:0:10350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2349:x1877914532486912:12345-192.168.201.27@tcp:8:lhsmtool_posix.0 Request processed in 490us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919120.141746:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 25 00000100:00100000:1.0:1790919120.144100:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919120.144185:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532487040 00000100:00100000:2.0:1790919120.144193:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532487040 00000100:00100000:2.0:1790919120.144281:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 26 00000100:00100000:2.0:1790919120.144289:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba027b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:0:x1877914532487040:12345-192.168.201.27@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1790919120.148379:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1790919120.277016:0:12020:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790919120.277026:0:12020:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790919120.277072:0:12020:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1790919120.277078:0:12020:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00100000:0.0:1790919120.283818:0:6722:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c4a4e085-55d7-40e9-993c-11b4dfc2d5f5 00000001:00080000:0.0:1790919120.283837:0:6722:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:2.0:1790919120.284779:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba027b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:0:x1877914532487040:12345-192.168.201.27@tcp:2:lhsmtool_posix.0 Request processed in 140481us (140677us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1790919120.284792:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 26 00000100:00100000:2.0:1790919120.306920:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919120.307017:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532487296 00000100:00100000:3.0:1790919120.307027:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532487296 00000100:00100000:3.0:1790919120.307108:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 19 00000100:00100000:3.0:1790919120.307120:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be85f38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+35:10424:x1877914532487296:12345-192.168.201.27@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790919120.307401:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be85f38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+36:10424:x1877914532487296:12345-192.168.201.27@tcp:35:lhsmtool_posix.0 Request processed in 283us (490us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1790919120.307410:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 19 00000100:00100000:3.0:1790919120.313471:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919120.313506:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532487552 00000100:00100000:3.0:1790919120.313516:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532487552 00000100:00100000:3.0:1790919120.313595:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 77 00000100:00100000:3.0:1790919120.313605:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+36:10424:x1877914532487552:12345-192.168.201.27@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790919120.313718:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+36:10424:x1877914532487552:12345-192.168.201.27@tcp:57:lhsmtool_posix.0 Request processed in 114us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919120.313725:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 77 00000100:00100000:3.0:1790919120.316219:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919120.316257:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532487680 00000100:00100000:3.0:1790919120.316265:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532487680 00000100:00100000:3.0:1790919120.316312:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 78 00000100:00100000:3.0:1790919120.316321:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+36:10424:x1877914532487680:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790919120.316354:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919120.316375:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c47f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672ccad expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919120.316477:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673600/0xc3296956897c47fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919120.316491:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673600/0xc3296956897c47fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919120.316503:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673600/0xc3296956897c47fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919120.316561:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790919120.316581:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673600/0xc3296956897c47fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919120.316608:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c47f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccad expref: 38 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919120.316626:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673600/0xc3296956897c47fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccad expref: 37 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919120.316635:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88be85efc500) 00010000:00010000:3.0:1790919120.316638:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1790919120.316641:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81673600, rc 0) 00000100:00100000:3.0:1790919120.316694:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+37:10424:x1877914532487680:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 374us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919120.316701:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 78 00000100:00100000:3.0:1790919120.320477:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919120.320716:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532487808 00000100:00100000:1.0:1790919120.320725:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532487808 00000100:00100000:1.0:1790919120.320789:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 27 00000100:00100000:1.0:1790919120.320798:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2351:x1877914532487808:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790919120.320814:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919120.320837:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068e31704/0xc3296956897c4802 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672ccb4 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790919120.320864:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abf41d0, blocks: 0x1 00010000:00010000:1.0:1790919120.320881:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=322s v=(0 0) 00010000:00010000:1.0:1790919120.320885:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919120.320894:0:6700:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068e31704/0xc3296956897c4802 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccb4 expref: 6 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919120.320929:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000068e31704/0xc3296956897c4802 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccb4 expref: 6 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919120.320942:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88beb3f7fe00, rc 0) 00000100:00100000:1.0:1790919120.320995:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2351:x1877914532487808:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 198us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919120.321003:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 27 00000100:00100000:0.0:1790919120.344292:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919120.344430:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532488064 00000100:00100000:3.0:1790919120.344441:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532488064 00000100:00100000:3.0:1790919120.344565:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 79 00000100:00100000:3.0:1790919120.344575:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+37:10424:x1877914532488064:12345-192.168.201.27@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790919120.344678:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+37:10424:x1877914532488064:12345-192.168.201.27@tcp:57:lhsmtool_posix.0 Request processed in 104us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919120.344686:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 79 00000100:00100000:2.0:1790919120.355179:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919120.355834:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532488192 00000100:00100000:3.0:1790919120.355845:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532488192 00000100:00100000:3.0:1790919120.355936:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 28 00000100:00100000:3.0:1790919120.355946:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be85f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:10424:x1877914532488192:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790919120.355965:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919120.355987:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fc75f30/0xc3296956897c4809 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672ccbb expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919120.356032:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000068e31704/0xc3296956897c4802 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccb4 expref: 7 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919120.356041:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919120.356046:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919120.356052:0:6698:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fc75f30/0xc3296956897c4809 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccbb expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919120.356099:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000068e31704/0xc3296956897c4802 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccb4 expref: 7 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919120.356115:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000068e31704/0xc3296956897c4802 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccb4 expref: 7 pid: 6700 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919120.356142:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb4264700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6698:1877914550338304:192.168.201.27@tcp:104: 00000100:00100000:3.0:1790919120.356234:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be84c9dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1790919120.363629:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919120.363752:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb4264700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6698:1877914550338304:192.168.201.27@tcp:104: 00010000:00010000:0.0:1790919120.363787:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fc75f30/0xc3296956897c4809 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccbb expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.363807:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81673800, rc 0) 00000100:00100000:0.0:1790919120.363877:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be85f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:10424:x1877914532488192:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 7932us (8709us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919120.363886:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 28 00000100:00100000:2.0:1790919120.364298:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532488320 00000100:00100000:2.0:1790919120.364307:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532488320 00010000:00010000:2.0:1790919120.364350:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000068e31704/0xc3296956897c4802 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccb4 expref: 7 pid: 6700 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919120.364388:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 42 00000100:00100000:2.0:1790919120.364397:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be91cae050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:2353:x1877914532488320:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790919120.364410:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919120.364433:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000068e31704/0xc3296956897c4802 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccb4 expref: 7 pid: 6700 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.364446:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000068e31704/0xc3296956897c4802 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccb4 expref: 7 pid: 6700 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.364472:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068e31704/0xc3296956897c4802 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccb4 expref: 7 pid: 6700 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.364501:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919120.364506:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919120.364513:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001fc75f30/0xc3296956897c4809 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccbb expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.364548:0:5831:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fc75f30/0xc3296956897c4809 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccbb expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.364584:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001fc75f30/0xc3296956897c4809 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccbb expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919120.364597:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be85f38a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5831:1877914550338432:192.168.201.27@tcp:105: 00000100:00100000:2.0:1790919120.364656:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bebf6ac780 going to sleep for 11 seconds 00000100:00100000:0.0:1790919120.368355:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be85f38a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5831:1877914550338432:192.168.201.27@tcp:105: 00010000:00010000:0.0:1790919120.368380:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919120.368436:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be91cae050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2353:x1877914532488320:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 4040us (4817us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919120.368447:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 42 00000100:00100000:0.0:1790919120.369485:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919120.369580:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532488448 00000100:00100000:1.0:1790919120.369588:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532488448 00002000:00100000:1.0:1790919120.369631:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff88bebac3ca80 x1877914532488448/t0(0) o4->c4a4e085-55d7-40e9-993c-11b4dfc2d5f5@192.168.201.27@tcp:241/0 lens 504/0 e 0 to 0 dl 1790919131 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790919120.369643:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88bebac3ca80 with x1877914532488448 ext(0->8) 00002000:00010000:1.0:1790919120.369648:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88bebac3ca80 00000100:00100000:1.0:1790919120.369671:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 0 00000100:00100000:1.0:1790919120.369680:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2351:x1877914532488448:12345-192.168.201.27@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1790919120.370235:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+8:2351:x1877914532488448:12345-192.168.201.27@tcp:4:lhsmtool_posix.0 Request processed in 555us (760us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1790919120.370244:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 0 00002000:00100000:1.0:1790919120.370251:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff88bebac3ca80 x1877914532488448/t4294967302(0) o4->c4a4e085-55d7-40e9-993c-11b4dfc2d5f5@192.168.201.27@tcp:241/0 lens 504/448 e 0 to 0 dl 1790919131 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790919120.370260:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88bebac3ca80 with x1877914532488448 ext(0->8) 00002000:00010000:1.0:1790919120.370264:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88bebac3ca80 00000100:00100000:2.0:1790919120.377229:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919120.377317:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532488576 00000100:00100000:0.0:1790919120.377336:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532488576 00000100:00100000:0.0:1790919120.377400:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 80 00000100:00100000:0.0:1790919120.377410:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be85f3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+37:10424:x1877914532488576:12345-192.168.201.27@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1790919120.447750:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be85f3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+37:10424:x1877914532488576:12345-192.168.201.27@tcp:44:lhsmtool_posix.0 Request processed in 70333us (70522us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919120.447773:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 80 00000001:00080000:0.0:1790919120.447809:0:5869:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:0.0:1790919120.447815:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:0.0:1790919120.447872:0:5869:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:0.0:1790919120.447882:0:5869:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:1.0:1790919120.447914:0:5880:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1790919120.447924:0:5880:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1790919120.448162:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790919120.448177:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550338560:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1790919120.448226:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919120.448279:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550338560 00000100:00100000:0.0:1790919120.448287:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550338560 00000100:00100000:0.0:1790919120.448336:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790919120.448344:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550338560:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1790919120.448497:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1790919120.448501:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1790919121 00002000:00010000:0.0:1790919120.448503:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1790919120.448505:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1790919120 -> 1790919121 00002000:00010000:0.0:1790919120.448507:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1790919120.448564:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1877914550338560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 221us (339us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1790919120.448571:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:0.0:1790919120.448616:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88bebac3c700/2, rc 0, transno 4294967303 00000100:00100000:0.0:1790919120.448621:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550338560:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1790919120.458817:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919120.458951:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532488704 00000100:00100000:3.0:1790919120.458961:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532488704 00000100:00100000:3.0:1790919120.459020:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 30 00000100:00100000:3.0:1790919120.459031:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+8:2350:x1877914532488704:12345-192.168.201.27@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1790919120.501854:0:6722:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:0.0:1790919120.501880:0:6722:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:3.0:1790919120.502033:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2350:x1877914532488704:12345-192.168.201.27@tcp:16:lhsmtool_posix.0 Request processed in 42997us (43218us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919120.502045:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 30 00000100:00100000:0.0:1790919120.505313:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919120.505430:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532488960 00000100:00100000:3.0:1790919120.505441:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532488960 00000100:00100000:3.0:1790919120.505569:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 81 00000100:00100000:3.0:1790919120.505582:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+13:10424:x1877914532488960:12345-192.168.201.27@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790919120.505640:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919120.505669:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673600/0xc3296956897c47fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccad expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919120.505690:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88be85efc500) 00010000:00010000:3.0:1790919120.505696:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790919120.505728:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4810 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919120.505990:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4810 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919120.506017:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4810 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790919120.506278:0:5846:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005d909594 reply state 000000002c882c1b transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4810 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919120.506288:0:5846:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790919120.506414:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+14:10424:x1877914532488960:12345-192.168.201.27@tcp:36:lhsmtool_posix.0 Request processed in 834us (1115us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1790919120.506423:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 81 00000100:00100000:2.0:1790919120.509299:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919120.509376:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532489088 00000100:00100000:0.0:1790919120.509386:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532489088 00000100:00100000:0.0:1790919120.509459:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 31 00000100:00100000:0.0:1790919120.509470:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be85f38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2350:x1877914532489088:12345-192.168.201.27@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1790919120.509769:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1790919120.509772:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1790919121 -> 1790919119 00002000:00010000:0.0:1790919120.509774:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1790919117 00002000:00010000:0.0:1790919120.509776:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1790919121 -> 1790919119 00002000:00010000:0.0:1790919120.509778:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1790919120.509838:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be85f38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:2350:x1877914532489088:12345-192.168.201.27@tcp:2:lhsmtool_posix.0 Request processed in 369us (548us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1790919120.509846:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 31 00010000:00010000:3.0:1790919120.510390:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4810 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919120.510403:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4810 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919120.510411:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4810 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919120.510417:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81672c00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919120.510422:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4810 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919120.510430:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4810 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919120.510454:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88be85efc500) 00010000:00010000:3.0:1790919120.510457:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919120.510461:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4810 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919120.510681:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4810 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919120.511866:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919120.511913:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532489344 00000100:00100000:2.0:1790919120.511922:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532489344 00000100:00100000:2.0:1790919120.512014:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 82 00000100:00100000:2.0:1790919120.512024:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba024380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+13:10424:x1877914532489344:12345-192.168.201.27@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1790919120.512086:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4817 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.512101:0:8231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c47d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc9f expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.512126:0:8231:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4817 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.512160:0:8231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c47d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc9f expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.512174:0:8231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c47d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc9f expref: 13 pid: 5847 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919120.512189:0:8231:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac91180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8231:1877914550338688:192.168.201.27@tcp:104: 00000100:00100000:2.0:1790919120.512280:0:8231:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be88024d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790919120.514251:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919120.514283:0:8231:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac91180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8231:1877914550338688:192.168.201.27@tcp:104: 00010000:00010000:2.0:1790919120.514307:0:8231:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4817 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919120.514376:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532489472 00000100:00100000:3.0:1790919120.514383:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532489472 00010000:00010000:3.0:1790919120.514419:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c47d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc9f expref: 14 pid: 5847 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919120.514680:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 43 00000100:00100000:2.0:1790919120.514692:0:8529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba026a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+14:2352:x1877914532489472:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790919120.514707:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919120.514715:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c47d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc9f expref: 14 pid: 5847 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.514727:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c47d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc9f expref: 14 pid: 5847 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.514853:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c47d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc9f expref: 14 pid: 5847 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.514882:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88be85efc500) 00010000:00010000:2.0:1790919120.514887:0:8529:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4817 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.514895:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4817 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.514903:0:8529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4817 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.514975:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919120.515035:0:8529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba026a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+13:2352:x1877914532489472:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 344us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919120.515042:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 43 00010000:00010000:0.0:1790919120.515080:0:8231:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4817 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.515088:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4817 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.515115:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4817 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.515122:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4817 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.515128:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4817 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.515134:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386200 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919120.515138:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4817 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.515145:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4817 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.515154:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88be85efc500) 00010000:00010000:0.0:1790919120.515157:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1790919120.515160:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4817 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.515166:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4817 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919120.515252:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba024380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+12:10424:x1877914532489344:12345-192.168.201.27@tcp:55:lhsmtool_posix.0 Request processed in 3228us (3389us total) trans 0 rc -22/-22 00000100:00100000:0.0:1790919120.515280:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 82 00000100:00100000:1.0:1790919120.517624:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919120.518866:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532489600 00000100:00100000:0.0:1790919120.518877:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532489600 00000100:00100000:0.0:1790919120.518977:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 32 00000100:00100000:0.0:1790919120.518988:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba024000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:2351:x1877914532489600:12345-192.168.201.27@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1790919120.519034:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007beff5c6/0xc3296956897c481e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.519069:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001fc75f30/0xc3296956897c4809 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccbb expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.519078:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919120.519083:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790919120.519087:0:6698:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007beff5c6/0xc3296956897c481e lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.519122:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001fc75f30/0xc3296956897c4809 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccbb expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.519137:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001fc75f30/0xc3296956897c4809 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccbb expref: 7 pid: 6698 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919120.519152:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf78aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6698:1877914550338816:192.168.201.27@tcp:104: 00000100:00100000:0.0:1790919120.519238:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be9584f540 going to sleep for 11 seconds 00000100:00100000:3.0:1790919120.522001:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919120.522156:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf78aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6698:1877914550338816:192.168.201.27@tcp:104: 00000100:00100000:1.0:1790919120.522185:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532489728 00000100:00100000:1.0:1790919120.522191:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532489728 00010000:00010000:0.0:1790919120.522193:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007beff5c6/0xc3296956897c481e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919120.522223:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001fc75f30/0xc3296956897c4809 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccbb expref: 8 pid: 6698 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919120.522261:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 44 00000100:00100000:1.0:1790919120.522281:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4264000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+8:2353:x1877914532489728:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790919120.522298:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919120.522330:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001fc75f30/0xc3296956897c4809 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccbb expref: 8 pid: 6698 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919120.522344:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001fc75f30/0xc3296956897c4809 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccbb expref: 8 pid: 6698 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919120.522370:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fc75f30/0xc3296956897c4809 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccbb expref: 8 pid: 6698 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919120.522386:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790919120.522391:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790919120.522396:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007beff5c6/0xc3296956897c481e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919120.522418:0:5829:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007beff5c6/0xc3296956897c481e lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919120.522580:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919120.522636:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4264000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:2353:x1877914532489728:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 366us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919120.522644:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 44 00010000:00010000:0.0:1790919120.522804:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007beff5c6/0xc3296956897c481e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.522814:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007beff5c6/0xc3296956897c481e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.522840:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007beff5c6/0xc3296956897c481e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.522849:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007beff5c6/0xc3296956897c481e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.522856:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007beff5c6/0xc3296956897c481e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.522863:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac58e00 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:0.0:1790919120.522867:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007beff5c6/0xc3296956897c481e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.522875:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007beff5c6/0xc3296956897c481e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.522886:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007beff5c6/0xc3296956897c481e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.522900:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007beff5c6/0xc3296956897c481e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919120.523842:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba024000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2351:x1877914532489600:12345-192.168.201.27@tcp:1:lhsmtool_posix.0 Request processed in 4850us (6221us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919120.523854:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 32 00000100:00100000:3.0:1790919120.529979:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919120.530407:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532489984 00000100:00100000:0.0:1790919120.530419:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532489984 00000100:00100000:0.0:1790919120.530562:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 83 00000100:00100000:0.0:1790919120.530574:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+12:10424:x1877914532489984:12345-192.168.201.27@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790919120.530662:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59600/0xc3296956897c4825 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.530682:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59600/0xc3296956897c4825 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.530693:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59600/0xc3296956897c4825 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.530947:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c482c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.530959:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c47e6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cca6 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.530966:0:5847:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c482c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.531009:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c47e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cca6 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.531022:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c47e6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cca6 expref: 13 pid: 5847 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919120.531036:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf78aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1877914550338944:192.168.201.27@tcp:104: 00000100:00100000:0.0:1790919120.531235:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be9584f540 going to sleep for 11 seconds 00000100:00100000:1.0:1790919120.535002:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919120.535365:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532490112 00000100:00100000:3.0:1790919120.535377:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532490112 00010000:00010000:3.0:1790919120.535419:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c47e6 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cca6 expref: 14 pid: 5847 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919120.535468:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 45 00000100:00100000:3.0:1790919120.535478:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba026d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+14:2352:x1877914532490112:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919120.535493:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919120.535501:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c47e6 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cca6 expref: 14 pid: 5847 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919120.535513:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c47e6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cca6 expref: 14 pid: 5847 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919120.535573:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88be85efc500) 00010000:00010000:3.0:1790919120.535579:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c482c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919120.535606:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c482c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919120.535614:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c482c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919120.535633:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919120.535691:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba026d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+14:2352:x1877914532490112:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 214us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919120.535698:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 45 00010000:00010000:0.0:1790919120.536867:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c47e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cca6 expref: 13 pid: 5847 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919120.536888:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf78aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1877914550338944:192.168.201.27@tcp:104: 00010000:00010000:0.0:1790919120.536912:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c482c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.536923:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c482c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.536929:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c482c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790919120.537822:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1790919120.537975:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1790919120.538020:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1790919120.538144:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf78aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5847:1877914550339072:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1790919120.538204:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919120.538241:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb3b5c180 going to sleep for 11 seconds 00000100:00100000:1.0:1790919120.538605:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550339072 00000100:00100000:1.0:1790919120.538613:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550339072 00000100:00100000:1.0:1790919120.538660:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790919120.538669:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5847:x1877914550339072:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1790919120.538770:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5847:x1877914550339072:12345-0@lo:1000:mdt00_002.0 Request processed in 102us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919120.538777:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790919120.538865:0:5847:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1790919120.538871:0:5847:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88bebac3c700, transno 4294967303 00000100:00100000:3.0:1790919120.538892:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf78aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5847:1877914550339072:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1790919120.539853:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1790919120.539922:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb4266300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5847:1877914550339200:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1790919120.539969:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919120.539993:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be9584f540 going to sleep for 11 seconds 00000100:00100000:2.0:1790919120.540102:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550339200 00000100:00100000:2.0:1790919120.540108:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550339200 00000100:00100000:2.0:1790919120.540136:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790919120.540143:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5847:x1877914550339200:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1790919120.540342:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5847:x1877914550339200:12345-0@lo:1000:mdt00_002.0 Request processed in 199us (371us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1790919120.540350:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790919120.540389:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb4266300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5847:1877914550339200:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1790919120.540420:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c482c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.540430:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c482c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.540638:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c482c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.540645:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac59800 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919120.540649:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c482c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.540658:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c482c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.540672:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88be85efc500) 00010000:00010000:2.0:1790919120.540675:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790919120.540679:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c482c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.540685:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c482c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.540723:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4761 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.540730:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4761 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.540735:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4761 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.540740:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81672e00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919120.540743:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4761 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.540759:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4761 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.540768:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be88e22300) 00010000:00010000:2.0:1790919120.540770:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790919120.540774:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4761 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.540780:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4761 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.541371:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4833 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.541390:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c477d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc8a expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.541399:0:5847:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4833 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.541430:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c477d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc8a expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.542158:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c477d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc8a expref: 16 pid: 5847 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919120.542175:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac91180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1877914550339328:192.168.201.27@tcp:104: 00000100:00100000:2.0:1790919120.542249:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beba8886c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790919120.550837:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919120.550895:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532490240 00000100:00100000:0.0:1790919120.550904:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532490240 00010000:00010000:0.0:1790919120.550937:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c477d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc8a expref: 17 pid: 5847 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919120.550968:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 46 00000100:00100000:0.0:1790919120.550975:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba027800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+17:2353:x1877914532490240:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790919120.550987:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919120.550992:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c477d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc8a expref: 17 pid: 5847 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.551002:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c477d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc8a expref: 17 pid: 5847 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.551022:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be88e22300) 00010000:00010000:0.0:1790919120.551026:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4833 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.551033:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4833 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.551038:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4833 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919120.551059:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919120.551108:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba027800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+17:2353:x1877914532490240:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 133us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919120.551113:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 46 00010000:00010000:2.0:1790919120.551974:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c477d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cc8a expref: 16 pid: 5847 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919120.551999:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac91180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1877914550339328:192.168.201.27@tcp:104: 00010000:00010000:2.0:1790919120.552017:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4833 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.552023:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4833 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.552027:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4833 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.552035:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4833 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.552039:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4833 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.552053:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4833 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.552057:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88387200 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919120.552060:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4833 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.552069:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4833 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.552077:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be88e22300) 00010000:00010000:2.0:1790919120.552079:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919120.552081:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4833 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.552092:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4833 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.552100:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59600/0xc3296956897c4825 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.552103:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59600/0xc3296956897c4825 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.552106:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59600/0xc3296956897c4825 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.552110:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac59600 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919120.552111:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59600/0xc3296956897c4825 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.552115:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59600/0xc3296956897c4825 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.552119:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be88e22300) 00010000:00010000:2.0:1790919120.552120:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790919120.552122:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59600/0xc3296956897c4825 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919120.552125:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59600/0xc3296956897c4825 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790919120.552483:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790919120.552489:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790919120.552516:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1790919120.552523:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790919120.552752:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+15:10424:x1877914532489984:12345-192.168.201.27@tcp:57:lhsmtool_posix.0 Request processed in 22179us (22781us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1790919120.552761:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 83 00000020:00080000:2.0:1790919120.552775:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1790919120.556994:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919120.557353:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532490496 00000100:00100000:3.0:1790919120.557364:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532490496 00000100:00100000:3.0:1790919120.557422:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 20 00000100:00100000:3.0:1790919120.557443:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+15:10424:x1877914532490496:12345-192.168.201.27@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1790919120.558520:0:5849:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1790919120.558843:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1790919120.558892:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c483a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919120.558908:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c483a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919120.558927:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c483a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919120.558935:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c483a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919120.558942:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c483a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919120.558948:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c483a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919120.558977:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790919120.560553:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+17:10424:x1877914532490496:12345-192.168.201.27@tcp:35:lhsmtool_posix.0 Request processed in 3090us (3547us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1790919120.560567:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 20 00000020:00080000:3.0:1790919120.560576:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790919120.560853:0:7650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919120.560862:0:7650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c483a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919120.560872:0:7650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81516600 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:1.0:1790919120.560889:0:7650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c483a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919120.560898:0:7650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c483a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919120.560914:0:7650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88be88e22900) 00010000:00010000:1.0:1790919120.560917:0:7650:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790919120.560921:0:7650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c483a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919120.560927:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c483a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919120.560947:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919120.560949:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919120.560950:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919120.641347:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790919120.641370:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550339456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790919120.641427:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919120.641576:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550339456 00000100:00100000:1.0:1790919120.641590:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550339456 00000100:00100000:1.0:1790919120.641632:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790919120.641639:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1877914550339456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790919120.641669:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919120.641706:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1877914550339456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919120.641711:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790919120.641760:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550339456:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790919121.151911:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790919121.741346:0:7662:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00080000:1.0:1790919121.741364:0:7662:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:1.0:1790919121.741371:0:7662:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:2.0:1790919122.183973:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790919122.253344:0:12073:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790919122.253362:0:12073:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790919122.253408:0:12073:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1790919122.253430:0:12073:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790919122.375729:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919122.375804:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532490752 00000100:00100000:0.0:1790919122.375822:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532490752 00000100:00100000:0.0:1790919122.375899:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 84 00000100:00100000:0.0:1790919122.375909:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+17:10442:x1877914532490752:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:0.0:1790919122.375943:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919122.375965:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4841 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672ccc2 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.376073:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58400/0xc3296956897c4848 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.376088:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58400/0xc3296956897c4848 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.376099:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58400/0xc3296956897c4848 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919122.376109:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1790919122.376224:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4841 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccc2 expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.376242:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58400/0xc3296956897c4848 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccc2 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.376250:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88be8b621100) 00010000:00010000:0.0:1790919122.376253:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790919122.376256:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac58400, rc 0) 00000100:00100000:0.0:1790919122.376328:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+19:10442:x1877914532490752:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 420us (608us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1790919122.376336:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 84 00000100:00080000:2.0:1790919122.377053:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790919122.397335:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919122.397464:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532490880 00000100:00100000:3.0:1790919122.397485:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532490880 00000100:00100000:3.0:1790919122.397563:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 85 00000100:00100000:3.0:1790919122.397573:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+19:10442:x1877914532490880:12345-192.168.201.27@tcp:34:lfs.0 00010000:00010000:3.0:1790919122.397655:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4856 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.397674:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4856 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.397687:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4856 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.397719:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c485d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.397727:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c485d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.397734:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c485d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.397974:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4864 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.397983:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4864 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.397990:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4864 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790919122.398029:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4864 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.398362:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4856 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.398370:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4856 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.398378:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4856 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.398385:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81672e00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919122.398389:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4856 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.398418:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4856 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.398431:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88be8b621100) 00010000:00010000:3.0:1790919122.398435:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919122.398440:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4856 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.398448:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4856 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.398462:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c485d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.398468:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c485d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.398474:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c485d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.398479:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81673200 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919122.398482:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c485d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.398487:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c485d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.398494:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88be88e22000) 00010000:00010000:3.0:1790919122.398496:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919122.398499:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c485d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.398515:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c485d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.398886:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4864 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.398894:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4864 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.398899:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4864 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.398904:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81673800 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919122.398907:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4864 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.398912:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4864 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.398986:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be88e22100) 00010000:00010000:3.0:1790919122.398990:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919122.398995:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4864 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.399001:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4864 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919122.399242:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+19:10442:x1877914532490880:12345-192.168.201.27@tcp:34:lfs.0 Request processed in 1667us (1917us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919122.399252:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 85 00000100:00100000:0.0:1790919122.474863:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919122.475054:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532491136 00000100:00100000:1.0:1790919122.475068:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532491136 00000100:00100000:1.0:1790919122.475118:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 86 00000100:00100000:1.0:1790919122.475126:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+19:10445:x1877914532491136:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:1.0:1790919122.475149:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919122.475169:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ec00/0xc3296956897c486b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672ccc9 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.475246:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f200/0xc3296956897c4872 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.475260:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f200/0xc3296956897c4872 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.475271:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f200/0xc3296956897c4872 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.475300:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f800/0xc3296956897c4879 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.475308:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f800/0xc3296956897c4879 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.475314:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f800/0xc3296956897c4879 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.475809:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e400/0xc3296956897c4880 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.475831:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e400/0xc3296956897c4880 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.475839:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e400/0xc3296956897c4880 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790919122.475850:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1790919122.475966:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f200/0xc3296956897c4872 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.475974:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f200/0xc3296956897c4872 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.475981:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f200/0xc3296956897c4872 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.475987:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88beb3f7f200 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:1.0:1790919122.475991:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f200/0xc3296956897c4872 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.475999:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f200/0xc3296956897c4872 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.476011:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88be8b621100) 00010000:00010000:1.0:1790919122.476014:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919122.476019:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f200/0xc3296956897c4872 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.476025:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f200/0xc3296956897c4872 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.476188:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f800/0xc3296956897c4879 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.476201:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f800/0xc3296956897c4879 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.476207:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f800/0xc3296956897c4879 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.476212:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88beb3f7f800 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:1.0:1790919122.476215:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f800/0xc3296956897c4879 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.476222:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f800/0xc3296956897c4879 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.476230:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88be8b621000) 00010000:00010000:1.0:1790919122.476232:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919122.476235:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f800/0xc3296956897c4879 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.476241:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f800/0xc3296956897c4879 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.476305:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ec00/0xc3296956897c486b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccc9 expref: 22 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.476322:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e400/0xc3296956897c4880 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccc9 expref: 21 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.476330:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be8b621d00) 00010000:00010000:1.0:1790919122.476332:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790919122.476341:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88beb3f7e400, rc 0) 00000100:00100000:1.0:1790919122.476746:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+21:10445:x1877914532491136:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 1617us (1892us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1790919122.476756:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 86 00000100:00100000:1.0:1790919122.480349:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919122.480506:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532491264 00000100:00100000:0.0:1790919122.480516:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532491264 00000100:00100000:0.0:1790919122.480599:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 87 00000100:00100000:0.0:1790919122.480609:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+21:10445:x1877914532491264:12345-192.168.201.27@tcp:54:lfs.0 00010000:00010000:0.0:1790919122.480682:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c488e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.480699:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c488e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.480711:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c488e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.480737:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c488e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.480744:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c488e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.480751:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c488e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.480757:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac59a00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919122.480761:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c488e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.480768:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c488e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.480778:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be8b621d00) 00010000:00010000:0.0:1790919122.480780:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790919122.480797:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c488e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.480803:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c488e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919122.480878:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+21:10445:x1877914532491264:12345-192.168.201.27@tcp:54:lfs.0 Request processed in 270us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919122.480886:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 87 00000100:00100000:2.0:1790919122.487208:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919122.487298:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532491520 00000100:00100000:0.0:1790919122.487310:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532491520 00000100:00100000:0.0:1790919122.487378:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 21 00000100:00100000:0.0:1790919122.487389:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9290a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+21:10445:x1877914532491520:12345-192.168.201.27@tcp:35:lfs.0 00000100:00100000:0.0:1790919122.487688:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9290a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+22:10445:x1877914532491520:12345-192.168.201.27@tcp:35:lfs.0 Request processed in 300us (490us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1790919122.487696:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 21 00000100:00100000:1.0:1790919122.554633:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919122.554678:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532491776 00000100:00100000:0.0:1790919122.554690:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532491776 00000100:00100000:0.0:1790919122.554755:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 88 00000100:00100000:0.0:1790919122.554765:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb40e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+22:9965:x1877914532491776:12345-192.168.201.27@tcp:101:bash.0 00010000:00010000:0.0:1790919122.554791:0:8231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919122.554812:0:8231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4895 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672ccd0 expref: -99 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.554912:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c489c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.554939:0:8231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e400/0xc3296956897c4880 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccc9 expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.554961:0:8231:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c489c lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.555000:0:8231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e400/0xc3296956897c4880 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccc9 expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.555014:0:8231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e400/0xc3296956897c4880 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccc9 expref: 23 pid: 5845 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919122.555039:0:8231:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8231:1877914550339584:192.168.201.27@tcp:104: 00000100:00100000:0.0:1790919122.555151:0:8231:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bebf6ac780 going to sleep for 11 seconds 00000100:00100000:0.0:1790919122.558396:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919122.559272:0:8529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532491904 00000100:00100000:1.0:1790919122.559295:0:8529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532491904 00010000:00010000:1.0:1790919122.559351:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e400/0xc3296956897c4880 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccc9 expref: 24 pid: 5845 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919122.559443:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 47 00000100:00100000:3.0:1790919122.559456:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+24:2353:x1877914532491904:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919122.559484:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919122.559492:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e400/0xc3296956897c4880 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccc9 expref: 24 pid: 5845 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.559506:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e400/0xc3296956897c4880 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccc9 expref: 24 pid: 5845 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.559549:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be8b621d00) 00010000:00010000:3.0:1790919122.559555:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c489c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.559565:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c489c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.559571:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c489c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.559592:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919122.559648:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+24:2353:x1877914532491904:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 195us (1262us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919122.559655:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 47 00010000:00010000:2.0:1790919122.561837:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e400/0xc3296956897c4880 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccc9 expref: 23 pid: 5845 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919122.561862:0:8231:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8231:1877914550339584:192.168.201.27@tcp:104: 00010000:00010000:2.0:1790919122.561886:0:8231:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c489c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.562012:0:8231:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c489c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.562020:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c489c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919122.562061:0:8231:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1790919122.562224:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4895 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccd0 expref: 24 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.562241:0:8231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c489c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccd0 expref: 23 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.562249:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be8b621d00) 00010000:00010000:0.0:1790919122.562252:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790919122.562269:0:8231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac58a00, rc 0) 00000100:00100000:0.0:1790919122.562350:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb40e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+23:9965:x1877914532491776:12345-192.168.201.27@tcp:101:bash.0 Request processed in 7585us (7726us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1790919122.562359:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 88 00000100:00100000:0.0:1790919122.568430:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919122.568722:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532492160 00000100:00100000:3.0:1790919122.568733:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532492160 00000100:00100000:3.0:1790919122.568788:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 89 00000100:00100000:3.0:1790919122.568797:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+23:9965:x1877914532492160:12345-192.168.201.27@tcp:36:bash.0 00010000:00010000:3.0:1790919122.569458:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c48aa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.569502:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c48aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.569514:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c48aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790919122.569828:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1790919122.569860:0:5846:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003ea51cb7 reply state 00000000e7d6e0e9 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c48aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919122.569870:0:5846:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1790919122.569932:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1790919122.570247:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+27:9965:x1877914532492160:12345-192.168.201.27@tcp:36:bash.0 Request processed in 1447us (1822us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1790919122.570257:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 89 00000020:00080000:3.0:1790919122.570263:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1790919122.575048:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919122.575123:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532492288 00000100:00100000:1.0:1790919122.575136:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532492288 00000100:00100000:1.0:1790919122.575192:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 90 00000100:00100000:1.0:1790919122.575201:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+27:9965:x1877914532492288:12345-192.168.201.27@tcp:101:bash.0 00010000:00010000:1.0:1790919122.575232:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919122.575254:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f200/0xc3296956897c48b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672ccd7 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.575332:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f200/0xc3296956897c48b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccd7 expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.575346:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f200/0xc3296956897c48b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccd7 expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.575364:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be8b621d00) 00010000:00010000:1.0:1790919122.575367:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790919122.575370:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88beb3f7f200, rc 0) 00000100:00100000:1.0:1790919122.575447:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+28:9965:x1877914532492288:12345-192.168.201.27@tcp:101:bash.0 Request processed in 246us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919122.575455:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 90 00010000:00010000:2.0:1790919122.575818:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c48aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919122.575829:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c48aa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919122.575836:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c48aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919122.575843:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81673800 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919122.575848:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c48aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919122.575856:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c48aa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919122.575877:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be8b621d00) 00010000:00010000:2.0:1790919122.575879:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919122.575884:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c48aa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919122.575891:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c48aa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919122.578668:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919122.578758:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532492416 00000100:00100000:0.0:1790919122.578767:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532492416 00000100:00100000:0.0:1790919122.578840:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 33 00000100:00100000:0.0:1790919122.578851:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0a5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:9965:x1877914532492416:12345-192.168.201.27@tcp:101:bash.0 00010000:00010000:0.0:1790919122.578872:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919122.578893:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641ed173/0xc3296956897c48b8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672ccde expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790919122.578918:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6abf41cf, atime: 0x6abf41cd, ctime: 0x6abf41cf, blocks: 0xb 00010000:00010000:0.0:1790919122.578942:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=324s v=(0 0) 00010000:00010000:0.0:1790919122.578948:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919122.578957:0:6700:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641ed173/0xc3296956897c48b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccde expref: 7 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.578976:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000641ed173/0xc3296956897c48b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccde expref: 7 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.578989:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac59a00, rc 0) 00000100:00100000:0.0:1790919122.579065:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0a5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:9965:x1877914532492416:12345-192.168.201.27@tcp:101:bash.0 Request processed in 215us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919122.579072:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 33 00000100:00080000:2.0:1790919122.579405:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790919122.581511:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919122.581815:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532492544 00000100:00100000:0.0:1790919122.581826:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532492544 00002000:00010000:0.0:1790919122.581863:0:6704:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1790919122.581867:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88beb4264380 with x1877914532492544 ext(0->18446744073709551615) 00002000:00010000:0.0:1790919122.581878:0:6704:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88beb4264380. 00000100:00100000:0.0:1790919122.581910:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 1 00000100:00100000:0.0:1790919122.581920:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:2353:x1877914532492544:12345-192.168.201.27@tcp:10:bash.0 00002000:00010000:0.0:1790919122.582213:0:6704:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1790919122.582216:0:6704:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1790919119 -> 1790919123 00002000:00010000:0.0:1790919122.582218:0:6704:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1790919117 -> 1790919117 00002000:00010000:0.0:1790919122.582219:0:6704:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1790919119 -> 1790919123 00002000:00010000:0.0:1790919122.582221:0:6704:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1790919122.582338:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+8:2353:x1877914532492544:12345-192.168.201.27@tcp:10:bash.0 Request processed in 419us (834us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1790919122.582345:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 1 00002000:00010000:0.0:1790919122.582349:0:6704:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1790919122.582351:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88beb4264380 with x1877914532492544 ext(0->18446744073709551615) 00002000:00010000:0.0:1790919122.582356:0:6704:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88beb4264380. 00000100:00100000:0.0:1790919122.652104:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919122.652192:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532492672 00000100:00100000:2.0:1790919122.652203:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532492672 00000100:00100000:2.0:1790919122.652265:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 91 00000100:00100000:2.0:1790919122.652276:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+27:10459:x1877914532492672:12345-192.168.201.27@tcp:34:lfs.0 00010000:00010000:2.0:1790919122.652358:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c48bf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919122.652375:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c48bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919122.652386:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c48bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919122.652400:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c48c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919122.652407:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c48c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919122.652413:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c48c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919122.652693:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c48cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919122.652703:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c48cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919122.652712:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c48cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790919122.652822:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c48cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.652835:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c48bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.652842:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c48bf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.652849:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c48bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.652855:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88387200 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919122.652866:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c48bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.652874:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c48bf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.652887:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88be8b621100) 00010000:00010000:3.0:1790919122.652890:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919122.652894:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c48bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.652900:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c48bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.652925:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c48c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.652931:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c48c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.652938:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c48c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.652943:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386e00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919122.652946:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c48c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.652951:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c48c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.652958:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88be85efc500) 00010000:00010000:3.0:1790919122.652961:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919122.652969:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c48c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.652976:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c48c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.652992:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c48cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.652998:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c48cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.653003:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c48cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.653008:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386c00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919122.653011:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c48cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.653017:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c48cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.653024:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be8b621d00) 00010000:00010000:3.0:1790919122.653276:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919122.653291:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c48cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.653299:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c48cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919122.653461:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+27:10459:x1877914532492672:12345-192.168.201.27@tcp:34:lfs.0 Request processed in 1113us (1291us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919122.653471:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 91 00000100:00100000:1.0:1790919122.688367:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550339712:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790919122.688457:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919122.689064:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550339712 00000100:00100000:2.0:1790919122.689075:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550339712 00000100:00100000:2.0:1790919122.689158:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790919122.689171:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb40e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1877914550339712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790919122.689220:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1790919122.689406:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790919122.689637:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb40e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1877914550339712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 467us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919122.689645:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790919122.691243:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550339712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790919122.693224:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919122.693327:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532492928 00000100:00100000:1.0:1790919122.693337:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532492928 00000100:00100000:1.0:1790919122.693395:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 92 00000100:00100000:1.0:1790919122.693405:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebacb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+27:10462:x1877914532492928:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:1.0:1790919122.693424:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919122.693444:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7fc00/0xc3296956897c48d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cce5 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.693549:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c48db lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.693565:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c48db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.693576:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c48db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.693591:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c48e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.693599:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c48e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.693624:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c48e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.693870:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f400/0xc3296956897c48e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.693878:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f400/0xc3296956897c48e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.693885:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f400/0xc3296956897c48e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790919122.693894:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1790919122.693978:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c48db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.693986:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c48db lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.693991:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c48db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.693996:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88beb3f7e200 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:1.0:1790919122.694000:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c48db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.694007:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c48db lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.694018:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88be8b621100) 00010000:00010000:1.0:1790919122.694021:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919122.694032:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c48db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.694039:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c48db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.694775:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c48e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.694786:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c48e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.694851:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c48e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.694856:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88beb3f7e600 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:1.0:1790919122.694859:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c48e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.694866:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c48e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.694878:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88be8b621000) 00010000:00010000:1.0:1790919122.694881:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919122.694884:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c48e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.694890:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c48e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.695004:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7fc00/0xc3296956897c48d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cce5 expref: 30 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.695037:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f400/0xc3296956897c48e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cce5 expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.695394:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be8b621d00) 00010000:00010000:1.0:1790919122.695399:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1790919122.695402:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88beb3f7f400, rc 0) 00000100:00100000:1.0:1790919122.695665:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebacb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+29:10462:x1877914532492928:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 2259us (2448us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1790919122.695676:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 92 00000100:00100000:0.0:1790919122.704192:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919122.704737:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532493056 00000100:00100000:3.0:1790919122.704749:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532493056 00000100:00100000:2.0:1790919122.705023:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 93 00000100:00100000:2.0:1790919122.705043:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebacb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+29:10462:x1877914532493056:12345-192.168.201.27@tcp:54:lfs.0 00010000:00010000:2.0:1790919122.705111:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c48f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919122.705130:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c489c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccd0 expref: 29 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919122.705139:0:5846:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c48f7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919122.705194:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c489c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccd0 expref: 29 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919122.705207:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c489c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccd0 expref: 29 pid: 8231 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919122.705222:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac91c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877914550339840:192.168.201.27@tcp:104: 00000100:00100000:2.0:1790919122.705324:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be88024d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790919122.708743:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac91c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877914550339840:192.168.201.27@tcp:104: 00010000:00010000:2.0:1790919122.708774:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c48f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919122.711240:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919122.711908:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532493312 00000100:00100000:2.0:1790919122.711929:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532493312 00000100:00100000:2.0:1790919122.711981:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 22 00000100:00100000:2.0:1790919122.711991:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebfbf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+30:5589:x1877914532493312:12345-192.168.201.27@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1790919122.712316:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebfbf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+31:5589:x1877914532493312:12345-192.168.201.27@tcp:35:ldlm_bl.0 Request processed in 325us (1088us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1790919122.712323:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 22 00000100:00100000:0.0:1790919122.715893:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919122.718572:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532493440 00000100:00100000:1.0:1790919122.718587:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532493440 00010000:00010000:1.0:1790919122.718635:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c489c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccd0 expref: 31 pid: 8231 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919122.718678:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 48 00000100:00100000:1.0:1790919122.718689:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+31:2353:x1877914532493440:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790919122.718705:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919122.718712:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c489c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccd0 expref: 31 pid: 8231 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.718724:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c489c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccd0 expref: 31 pid: 8231 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.718747:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c489c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccd0 expref: 31 pid: 8231 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.718783:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be8b621d00) 00010000:00010000:1.0:1790919122.718788:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c48f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.718810:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c48f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.718818:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c48f7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.718841:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919122.718909:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+30:2353:x1877914532493440:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 221us (3026us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919122.718928:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 48 00010000:00010000:0.0:1790919122.719418:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c48f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.719428:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c48f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.719469:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c48f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.719478:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c48f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.719486:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c48f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.719492:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88387c00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919122.719497:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c48f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.719504:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c48f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.719514:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be8b621d00) 00010000:00010000:0.0:1790919122.719517:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790919122.719521:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c48f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.719558:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c48f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919122.719612:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebacb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+29:10462:x1877914532493056:12345-192.168.201.27@tcp:54:lfs.0 Request processed in 14570us (15431us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919122.719621:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 93 00000100:00100000:0.0:1790919122.726737:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919122.726967:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532493696 00000100:00100000:1.0:1790919122.726978:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532493696 00000100:00100000:1.0:1790919122.727045:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 23 00000100:00100000:1.0:1790919122.727057:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+29:10462:x1877914532493696:12345-192.168.201.27@tcp:35:lfs.0 00000100:00100000:1.0:1790919122.727309:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+30:10462:x1877914532493696:12345-192.168.201.27@tcp:35:lfs.0 Request processed in 254us (580us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1790919122.727316:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 23 00000100:00100000:1.0:1790919122.858296:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919122.858669:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532493952 00000100:00100000:0.0:1790919122.858682:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532493952 00000100:00100000:0.0:1790919122.858761:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 94 00000100:00100000:0.0:1790919122.858771:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb40e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+30:10473:x1877914532493952:12345-192.168.201.27@tcp:101:cat.0 00010000:00010000:0.0:1790919122.858796:0:8231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919122.858817:0:8231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c48fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672ccec expref: -99 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.858904:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c4905 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.858920:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c4905 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.858932:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c4905 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.858947:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c490c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.858953:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c490c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.858960:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c490c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.859241:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c4913 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.859250:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c4913 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.859257:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c4913 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919122.859276:0:8231:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:0.0:1790919122.859378:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c4905 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.859387:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c4905 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.859393:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c4905 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.859400:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac58000 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919122.859404:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c4905 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.859413:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c4905 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.859425:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88be8b621100) 00010000:00010000:0.0:1790919122.859428:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919122.859433:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c4905 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.859439:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c4905 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.859452:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c490c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.859458:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c490c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.859474:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c490c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.859479:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac59000 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919122.859482:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c490c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.859489:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c490c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.859497:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88be853b5100) 00010000:00010000:0.0:1790919122.859499:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919122.859502:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c490c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.859508:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c490c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.859629:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c48fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccec expref: 33 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.859643:0:8231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c4913 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccec expref: 32 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.859650:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be8b621d00) 00010000:00010000:0.0:1790919122.859652:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790919122.859654:0:8231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac58200, rc 0) 00000100:00100000:0.0:1790919122.859720:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb40e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+32:10473:x1877914532493952:12345-192.168.201.27@tcp:101:cat.0 Request processed in 950us (1446us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1790919122.859737:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 94 00000100:00100000:0.0:1790919122.865463:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919122.865565:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532494208 00000100:00100000:1.0:1790919122.865576:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532494208 00000100:00100000:1.0:1790919122.865633:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 24 00000100:00100000:1.0:1790919122.865643:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+32:10473:x1877914532494208:12345-192.168.201.27@tcp:35:cat.0 00000100:00100000:1.0:1790919122.865900:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+33:10473:x1877914532494208:12345-192.168.201.27@tcp:35:cat.0 Request processed in 258us (446us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1790919122.865907:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 24 00000100:00100000:2.0:1790919122.888727:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919122.888811:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532494464 00000100:00100000:3.0:1790919122.888821:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532494464 00000100:00100000:3.0:1790919122.888883:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 95 00000100:00100000:3.0:1790919122.888894:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+33:10474:x1877914532494464:12345-192.168.201.27@tcp:36:rm.0 00010000:00010000:3.0:1790919122.888963:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1790919122.888990:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c4913 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccec expref: 33 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.889013:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f400/0xc3296956897c48e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cce5 expref: 32 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.889026:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f200/0xc3296956897c48b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccd7 expref: 31 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.889274:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be8b621d00) 00010000:00010000:3.0:1790919122.889295:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790919122.889318:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4921 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.889331:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4921 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.889341:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4921 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.889355:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4928 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.889378:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4928 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.889385:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4928 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.889654:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c492f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.889663:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c492f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.889670:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c492f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790919122.893231:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1790919122.893244:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 324781716845ns, next at 325781713876ns, rc = 0 00010000:00010000:2.0:1790919122.893330:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4936 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919122.893346:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4936 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919122.893364:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4936 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919122.893373:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4936 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919122.893379:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4936 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919122.893385:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4936 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919122.893519:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790919122.893568:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c492f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919122.893574:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c492f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919122.893581:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c492f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919122.893586:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81672c00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919122.893590:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c492f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919122.893598:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c492f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919122.893610:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be88e22000) 00010000:00010000:2.0:1790919122.893612:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1790919122.893623:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c492f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919122.893629:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c492f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919122.893650:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4921 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919122.893656:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4921 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919122.893662:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4921 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919122.893666:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81673200 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919122.893669:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4921 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919122.893674:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4921 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919122.893681:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88be8b621100) 00010000:00010000:2.0:1790919122.893683:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919122.893686:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4921 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919122.893691:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4921 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790919122.893701:0:5847:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c5c5327a reply state 00000000e90245f4 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4928 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919122.893717:0:5847:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790919122.893804:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+32:10474:x1877914532494464:12345-192.168.201.27@tcp:36:rm.0 Request processed in 4908us (5083us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1790919122.893813:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 95 00010000:00010000:3.0:1790919122.897389:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4928 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.897414:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4928 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.897421:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4928 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.897428:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81672e00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919122.897433:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4928 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.897441:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4928 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.897456:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88be88e22100) 00010000:00010000:3.0:1790919122.897475:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919122.897480:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4928 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.897486:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4928 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.897782:0:7650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919122.897790:0:7650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4936 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.897796:0:7650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386200 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:1.0:1790919122.897800:0:7650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4936 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.897807:0:7650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4936 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.897816:0:7650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88be88e22000) 00010000:00010000:1.0:1790919122.897818:0:7650:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790919122.897820:0:7650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4936 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.897825:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4936 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919122.897838:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919122.897840:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919122.897842:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919122.947492:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919122.947718:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532494720 00000100:00100000:0.0:1790919122.947729:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532494720 00000100:00100000:0.0:1790919122.947791:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 96 00000100:00100000:0.0:1790919122.947802:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+31:10480:x1877914532494720:12345-192.168.201.27@tcp:101:bash.0 00010000:00010000:0.0:1790919122.947828:0:8231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919122.947849:0:8231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c493d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672ccf3 expref: -99 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.947974:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58600/0xc3296956897c4944 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.947989:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58600/0xc3296956897c4944 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.948000:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58600/0xc3296956897c4944 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.948014:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c494b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.948021:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c494b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.948041:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c494b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790919122.949472:0:8231:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1790919122.949689:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c4952 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.949712:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c4952 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.949722:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c4952 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.949764:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58600/0xc3296956897c4944 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.949771:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58600/0xc3296956897c4944 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.949777:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58600/0xc3296956897c4944 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.949782:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac58600 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919122.949787:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58600/0xc3296956897c4944 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.949794:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58600/0xc3296956897c4944 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.949805:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88be8b621100) 00010000:00010000:0.0:1790919122.949808:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919122.949812:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58600/0xc3296956897c4944 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.949817:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58600/0xc3296956897c4944 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790919122.949830:0:8231:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000035f6eefe reply state 0000000031fb3f8b transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c494b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919122.949846:0:8231:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790919122.949884:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c493d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccf3 expref: 34 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.949898:0:8231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c4952 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccf3 expref: 33 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919122.949905:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88be853b5400) 00010000:00010000:0.0:1790919122.949907:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790919122.949909:0:8231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac58c00, rc 0) 00000100:00100000:0.0:1790919122.950685:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+34:10480:x1877914532494720:12345-192.168.201.27@tcp:101:bash.0 Request processed in 2882us (3201us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1790919122.950695:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 96 00000100:00100000:0.0:1790919122.955006:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00010000:00010000:2.0:1790919122.955351:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c494b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919122.955366:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c494b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919122.955374:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c494b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919122.955379:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac59200 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919122.955383:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c494b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919122.955391:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c494b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919122.955414:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88be853b5100) 00010000:00010000:2.0:1790919122.955417:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919122.955422:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c494b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919122.955428:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c494b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919122.955638:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532494848 00000100:00100000:3.0:1790919122.955650:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532494848 00000100:00100000:3.0:1790919122.955749:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 34 00000100:00100000:3.0:1790919122.955759:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2353:x1877914532494848:12345-192.168.201.27@tcp:101:bash.0 00010000:00010000:3.0:1790919122.955776:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919122.955793:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093b64d66/0xc3296956897c4960 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672ccfa expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790919122.955821:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919122.955840:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=324s v=(0 0) 00010000:00010000:3.0:1790919122.955844:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919122.955854:0:6699:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093b64d66/0xc3296956897c4960 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccfa expref: 6 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.955871:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000093b64d66/0xc3296956897c4960 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccfa expref: 6 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.955881:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81672e00, rc 0) 00000100:00100000:3.0:1790919122.955957:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2353:x1877914532494848:12345-192.168.201.27@tcp:101:bash.0 Request processed in 199us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919122.955964:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 34 00000100:00100000:1.0:1790919122.958885:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919122.959062:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532494976 00000100:00100000:3.0:1790919122.959072:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532494976 00000100:00100000:3.0:1790919122.959126:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 35 00000100:00100000:3.0:1790919122.959136:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb40e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:10480:x1877914532494976:12345-192.168.201.27@tcp:101:bash.0 00010000:00010000:3.0:1790919122.959155:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919122.959174:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f462e5f7/0xc3296956897c4967 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cd01 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.959203:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000093b64d66/0xc3296956897c4960 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccfa expref: 7 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.959211:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919122.959215:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919122.959219:0:6700:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f462e5f7/0xc3296956897c4967 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd01 expref: 7 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.959252:0:6700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000093b64d66/0xc3296956897c4960 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccfa expref: 7 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.959266:0:6700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000093b64d66/0xc3296956897c4960 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccfa expref: 7 pid: 6699 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919122.959292:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb4266a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6700:1877914550339968:192.168.201.27@tcp:104: 00000100:00100000:3.0:1790919122.959377:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bebfbc9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790919122.963801:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb4266a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6700:1877914550339968:192.168.201.27@tcp:104: 00010000:00010000:3.0:1790919122.963838:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f462e5f7/0xc3296956897c4967 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd01 expref: 7 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.963878:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81673600, rc 0) 00000100:00100000:3.0:1790919122.963964:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb40e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:10480:x1877914532494976:12345-192.168.201.27@tcp:101:bash.0 Request processed in 4829us (5090us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919122.963973:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 35 00000100:00100000:0.0:1790919122.964389:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919122.965478:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532495104 00000100:00100000:3.0:1790919122.965489:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532495104 00010000:00010000:3.0:1790919122.965583:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000093b64d66/0xc3296956897c4960 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccfa expref: 7 pid: 6699 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919122.965615:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 49 00000100:00100000:3.0:1790919122.965624:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be91cacc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:2352:x1877914532495104:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919122.965639:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919122.965664:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000093b64d66/0xc3296956897c4960 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccfa expref: 7 pid: 6699 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.965677:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000093b64d66/0xc3296956897c4960 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccfa expref: 7 pid: 6699 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.965699:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093b64d66/0xc3296956897c4960 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccfa expref: 7 pid: 6699 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.965716:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919122.965720:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919122.965728:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f462e5f7/0xc3296956897c4967 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd01 expref: 6 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.965753:0:5830:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f462e5f7/0xc3296956897c4967 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd01 expref: 6 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919122.965791:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f462e5f7/0xc3296956897c4967 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd01 expref: 6 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919122.965805:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb4266a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5830:1877914550340096:192.168.201.27@tcp:105: 00000100:00100000:3.0:1790919122.965876:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bebfbc9b40 going to sleep for 11 seconds 00000100:00080000:2.0:1790919122.966422:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790919122.970750:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb4266a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5830:1877914550340096:192.168.201.27@tcp:105: 00010000:00010000:0.0:1790919122.970778:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919122.970840:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be91cacc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2352:x1877914532495104:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 5216us (6452us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919122.970851:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 49 00000100:00100000:2.0:1790919122.973005:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919122.973266:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532495360 00000100:00100000:1.0:1790919122.973274:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532495360 00000100:00100000:1.0:1790919122.973341:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 25 00000100:00100000:1.0:1790919122.973350:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+33:10480:x1877914532495360:12345-192.168.201.27@tcp:35:bash.0 00000100:00100000:1.0:1790919122.973795:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+34:10480:x1877914532495360:12345-192.168.201.27@tcp:35:bash.0 Request processed in 444us (795us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1790919122.973803:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 25 00000100:00100000:1.0:1790919123.138792:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919123.138903:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532495488 00000100:00100000:0.0:1790919123.138929:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532495488 00000100:00100000:0.0:1790919123.138997:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 97 00000100:00100000:0.0:1790919123.139007:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb40e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+34:10496:x1877914532495488:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:0.0:1790919123.139042:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919123.139088:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58e00/0xc3296956897c496e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cd08 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.139161:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59600/0xc3296956897c4975 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.139175:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59600/0xc3296956897c4975 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.139189:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59600/0xc3296956897c4975 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919123.139224:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1790919123.139227:0:5846:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790919123.139245:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59600/0xc3296956897c4975 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.139269:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58e00/0xc3296956897c496e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd08 expref: 36 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.139301:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59600/0xc3296956897c4975 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd08 expref: 35 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.139310:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88be8b621100) 00010000:00010000:0.0:1790919123.139313:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790919123.139316:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac59600, rc 0) 00000100:00100000:0.0:1790919123.139596:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb40e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+35:10496:x1877914532495488:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 588us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919123.139603:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 97 00000100:00100000:0.0:1790919123.145487:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919123.145610:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532495744 00000100:00100000:1.0:1790919123.145621:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532495744 00000100:00100000:1.0:1790919123.145715:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 98 00000100:00100000:1.0:1790919123.145728:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+35:10496:x1877914532495744:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:1.0:1790919123.145751:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919123.145774:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ea00/0xc3296956897c497c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cd0f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.145882:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f600/0xc3296956897c4983 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.145897:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f600/0xc3296956897c4983 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.145983:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f600/0xc3296956897c4983 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790919123.145998:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1790919123.146260:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ea00/0xc3296956897c497c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd0f expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.146295:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f600/0xc3296956897c4983 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd0f expref: 37 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.146317:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88be853b5400) 00010000:00010000:1.0:1790919123.146320:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790919123.146323:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88beb3f7f600, rc 0) 00000100:00100000:1.0:1790919123.146564:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+37:10496:x1877914532495744:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 800us (1048us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1790919123.146574:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 98 00000100:00100000:2.0:1790919123.152702:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919123.152782:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919123.152870:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532496000 00000100:00100000:3.0:1790919123.152882:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532496000 00000100:00100000:3.0:1790919123.152946:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 99 00000100:00100000:3.0:1790919123.152957:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+37:10496:x1877914532496000:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:3.0:1790919123.152983:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919123.153006:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4991 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cd16 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.153442:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4998 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.153458:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4998 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.153469:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4998 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919123.153482:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1790919123.153653:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4991 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd16 expref: 40 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.153672:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4998 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd16 expref: 39 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.153681:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88be853b5400) 00010000:00010000:3.0:1790919123.153684:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1790919123.153688:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81673200, rc 0) 00000100:00100000:3.0:1790919123.153794:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+39:10496:x1877914532496000:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 838us (1101us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1790919123.153802:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 99 00000100:00100000:1.0:1790919123.153953:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532496128 00000100:00100000:1.0:1790919123.153959:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532496128 00000100:00100000:1.0:1790919123.154002:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 6 00000100:00100000:1.0:1790919123.154011:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+39:2352:x1877914532496128:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790919123.154031:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919123.154676:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f600/0xc3296956897c4983 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd0f expref: 39 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.154696:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88be853b5400) 00010000:00010000:1.0:1790919123.154700:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919123.154732:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+38:2352:x1877914532496128:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 723us (1950us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919123.154740:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 6 00000100:00100000:2.0:1790919123.169003:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919123.169346:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532496256 00000100:00100000:3.0:1790919123.169357:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532496256 00000100:00100000:3.0:1790919123.169435:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 36 00000100:00100000:3.0:1790919123.169446:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2353:x1877914532496256:12345-192.168.201.27@tcp:1:lfs.0 00010000:00010000:3.0:1790919123.169495:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f64d7815/0xc3296956897c49a6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.169517:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f462e5f7/0xc3296956897c4967 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd01 expref: 6 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.169560:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1790919123.169565:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790919123.169570:0:6699:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f64d7815/0xc3296956897c49a6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.169606:0:6699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f462e5f7/0xc3296956897c4967 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd01 expref: 6 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.169632:0:6699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f462e5f7/0xc3296956897c4967 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd01 expref: 6 pid: 6700 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919123.169647:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb4265c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6699:1877914550340224:192.168.201.27@tcp:104: 00000100:00100000:3.0:1790919123.169730:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bebfbc9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790919123.174334:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919123.174696:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532496384 00000100:00100000:1.0:1790919123.174708:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532496384 00002000:00100000:1.0:1790919123.174765:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff88bebac5e680 x1877914532496384/t0(0) o4->c4a4e085-55d7-40e9-993c-11b4dfc2d5f5@192.168.201.27@tcp:244/0 lens 504/0 e 0 to 0 dl 1790919134 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790919123.174777:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88bebac5e680 with x1877914532496384 ext(0->8) 00010000:00010000:1.0:1790919123.174786:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f462e5f7/0xc3296956897c4967 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd01 expref: 7 pid: 6700 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.174818:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f462e5f7/0xc3296956897c4967 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd01 expref: 7 pid: 6700 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790919123.174827:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88bebac5e680 00000100:00100000:1.0:1790919123.174851:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 1 00000100:00100000:1.0:1790919123.174862:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:2353:x1877914532496384:12345-192.168.201.27@tcp:4:lfs.0 00000100:00100000:1.0:1790919123.175661:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+9:2353:x1877914532496384:12345-192.168.201.27@tcp:4:lfs.0 Request processed in 797us (1333us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1790919123.175671:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 1 00002000:00100000:1.0:1790919123.175679:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff88bebac5e680 x1877914532496384/t4294967302(0) o4->c4a4e085-55d7-40e9-993c-11b4dfc2d5f5@192.168.201.27@tcp:244/0 lens 504/448 e 0 to 0 dl 1790919134 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790919123.175687:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88bebac5e680 with x1877914532496384 ext(0->8) 00010000:00010000:1.0:1790919123.175695:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f462e5f7/0xc3296956897c4967 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd01 expref: 9 pid: 6700 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.175708:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f462e5f7/0xc3296956897c4967 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd01 expref: 9 pid: 6700 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790919123.175714:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88bebac5e680 00000100:00100000:3.0:1790919123.175826:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb4265c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6699:1877914550340224:192.168.201.27@tcp:104: 00010000:00010000:3.0:1790919123.175851:0:6699:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f64d7815/0xc3296956897c49a6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919123.180339:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919123.180566:0:8529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532496512 00000100:00100000:2.0:1790919123.180578:0:8529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532496512 00010000:00010000:2.0:1790919123.180618:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f462e5f7/0xc3296956897c4967 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd01 expref: 9 pid: 6700 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919123.180651:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 50 00000100:00100000:2.0:1790919123.180660:0:8529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+9:2350:x1877914532496512:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790919123.180675:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1790919123.180694:0:8529:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1790919123.180696:0:8529:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1790919123 00002000:00010000:2.0:1790919123.180699:0:8529:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1790919123 00002000:00010000:2.0:1790919123.180701:0:8529:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1790919123 00010000:00010000:2.0:1790919123.180707:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f462e5f7/0xc3296956897c4967 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd01 expref: 9 pid: 6700 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.180720:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f462e5f7/0xc3296956897c4967 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd01 expref: 9 pid: 6700 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.180744:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f462e5f7/0xc3296956897c4967 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd01 expref: 9 pid: 6700 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.180761:0:8529:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790919123.180766:0:8529:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790919123.180787:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f64d7815/0xc3296956897c49a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.180798:0:8529:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f64d7815/0xc3296956897c49a6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.180833:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919123.180888:0:8529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+8:2350:x1877914532496512:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 228us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919123.180896:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 50 00010000:00010000:3.0:1790919123.181756:0:6699:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f64d7815/0xc3296956897c49a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.181770:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f64d7815/0xc3296956897c49a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.181800:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f64d7815/0xc3296956897c49a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.181809:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f64d7815/0xc3296956897c49a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.181818:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f64d7815/0xc3296956897c49a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.181840:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81672c00 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:3.0:1790919123.181845:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f64d7815/0xc3296956897c49a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.181854:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f64d7815/0xc3296956897c49a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.181868:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f64d7815/0xc3296956897c49a6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.181876:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f64d7815/0xc3296956897c49a6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919123.181959:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:2353:x1877914532496256:12345-192.168.201.27@tcp:1:lfs.0 Request processed in 12512us (12963us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919123.181968:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 36 00000100:00100000:0.0:1790919123.187392:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919123.187480:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532496768 00000100:00100000:1.0:1790919123.187492:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532496768 00000100:00100000:1.0:1790919123.187581:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 26 00000100:00100000:1.0:1790919123.187592:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be92908c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+38:10496:x1877914532496768:12345-192.168.201.27@tcp:35:lfs.0 00000004:00010000:1.0:1790919123.187683:0:5848:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4998 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd16 expref: 38 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790919123.188325:0:5848:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1790919123.188372:0:5848:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1790919123.188709:0:5848:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1790919123.188758:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c49ad lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.188775:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c4952 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccf3 expref: 42 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.188784:0:5848:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c49ad lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.188820:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c4952 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccf3 expref: 42 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.188835:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c4952 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccf3 expref: 42 pid: 8231 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919123.188849:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb35b3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5848:1877914550340352:192.168.201.27@tcp:104: 00000100:00100000:0.0:1790919123.189109:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bebf6ac780 going to sleep for 11 seconds 00000100:00100000:2.0:1790919123.193290:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919123.193375:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532496896 00000100:00100000:3.0:1790919123.193385:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532496896 00010000:00010000:3.0:1790919123.193434:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c4952 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccf3 expref: 43 pid: 8231 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919123.193481:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 51 00000100:00100000:3.0:1790919123.193494:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+43:2352:x1877914532496896:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919123.193511:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919123.193518:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c4952 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccf3 expref: 43 pid: 8231 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.193582:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c4952 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccf3 expref: 43 pid: 8231 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.193605:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88be853b5400) 00010000:00010000:3.0:1790919123.193611:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c49ad lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.193620:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c49ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.193627:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c49ad lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.193646:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919123.193695:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+43:2352:x1877914532496896:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 204us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919123.193703:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 51 00010000:00010000:0.0:1790919123.194502:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c4952 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccf3 expref: 42 pid: 8231 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919123.194521:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb35b3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5848:1877914550340352:192.168.201.27@tcp:104: 00010000:00010000:0.0:1790919123.194581:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c49ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.194606:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c49ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.194611:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c49ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790919123.194734:0:5848:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1790919123.194952:0:5848:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1790919123.195093:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb35b3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1877914550340480:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1790919123.195160:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919123.195208:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550340480 00000100:00100000:0.0:1790919123.195214:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550340480 00000100:00100000:0.0:1790919123.195265:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790919123.195287:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd82803480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5848:x1877914550340480:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1790919123.195356:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd82803480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5848:x1877914550340480:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 83us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919123.195364:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1790919123.195390:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790919123.195401:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be91c7c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919123.195417:0:5848:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1790919123.195423:0:5848:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:0.0:1790919123.195440:0:5848:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88bebf789c00, transno 4294967301 00000100:00100000:0.0:1790919123.195451:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb35b3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1877914550340480:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1790919123.195921:0:5848:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1790919123.195979:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb35b3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1877914550340608:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1790919123.196011:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919123.196049:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550340608 00000100:00100000:0.0:1790919123.196053:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550340608 00000100:00100000:0.0:1790919123.196077:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790919123.196085:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88d98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5848:x1877914550340608:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1790919123.196223:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88d98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5848:x1877914550340608:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 139us (210us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1790919123.196230:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790919123.196252:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bebf6ac780 going to sleep for 11 seconds 00000100:00100000:0.0:1790919123.196286:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb35b3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1877914550340608:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1790919123.196327:0:5848:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1790919123.196363:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c49ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.196374:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c49ad lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.196382:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c49ad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.196389:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac59800 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919123.196393:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c49ad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.196402:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c49ad lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.196418:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88be853b5400) 00010000:00010000:0.0:1790919123.196421:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1790919123.196426:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c49ad lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.196444:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c49ad lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790919123.196632:0:5848:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1790919123.196754:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:0.0:1790919123.196766:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 325085238169ns, next at 326085236160ns, rc = 0 00000001:00080000:0.0:1790919123.196772:0:5848:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1790919123.196804:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88be853b5400) 00010000:00010000:0.0:1790919123.196807:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790919123.196815:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4998 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd16 expref: 46 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919123.196907:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be92908c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+45:10496:x1877914532496768:12345-192.168.201.27@tcp:35:lfs.0 Request processed in 9317us (9524us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1790919123.196914:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 26 00000020:00080000:0.0:1790919123.196918:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00010000:00010000:2.0:1790919123.201622:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919123.206344:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919123.206655:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532497024 00000100:00100000:0.0:1790919123.206666:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532497024 00000100:00100000:0.0:1790919123.206775:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 100 00000100:00100000:0.0:1790919123.206787:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+45:10496:x1877914532497024:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:0.0:1790919123.206816:0:8231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919123.206840:0:8231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c49b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cd1d expref: -99 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.206901:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c49b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd1d expref: 46 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.206952:0:8231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c49b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd1d expref: 46 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.206975:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88be853b5400) 00010000:00010000:0.0:1790919123.206978:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790919123.206982:0:8231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac59800, rc 0) 00000100:00100000:0.0:1790919123.207203:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+46:10496:x1877914532497024:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 417us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919123.207211:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 100 00000100:00100000:2.0:1790919123.211997:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919123.212378:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532497280 00000100:00100000:3.0:1790919123.212444:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532497280 00000100:00100000:3.0:1790919123.212567:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 27 00000100:00100000:3.0:1790919123.212578:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be83439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+46:10496:x1877914532497280:12345-192.168.201.27@tcp:35:lfs.0 00000100:00100000:3.0:1790919123.212843:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be83439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+47:10496:x1877914532497280:12345-192.168.201.27@tcp:35:lfs.0 Request processed in 266us (857us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1790919123.212851:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 27 00000100:00100000:2.0:1790919123.325135:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919123.325301:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532497408 00000100:00100000:0.0:1790919123.325310:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532497408 00000100:00100000:0.0:1790919123.325366:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 101 00000100:00100000:0.0:1790919123.325374:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be83439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+47:10507:x1877914532497408:12345-192.168.201.27@tcp:34:lfs.0 00010000:00010000:0.0:1790919123.325458:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c49bb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.325475:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c49bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.325487:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c49bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.325500:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58e00/0xc3296956897c49c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.325508:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58e00/0xc3296956897c49c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.325567:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58e00/0xc3296956897c49c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.325648:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58600/0xc3296956897c49c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.325656:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58600/0xc3296956897c49c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.325663:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58600/0xc3296956897c49c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790919123.325705:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58600/0xc3296956897c49c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.325716:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c49bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.325723:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c49bb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.325731:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c49bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.325736:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac58c00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919123.325741:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c49bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.325748:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c49bb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.325758:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88be8b621100) 00010000:00010000:0.0:1790919123.325766:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919123.325771:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c49bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.325778:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c49bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.325791:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58e00/0xc3296956897c49c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.325798:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58e00/0xc3296956897c49c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.325804:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58e00/0xc3296956897c49c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.325809:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac58e00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919123.325811:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58e00/0xc3296956897c49c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.325817:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58e00/0xc3296956897c49c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.325823:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88be853b5d00) 00010000:00010000:0.0:1790919123.325825:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919123.325828:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58e00/0xc3296956897c49c2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.325833:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58e00/0xc3296956897c49c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.325845:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58600/0xc3296956897c49c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.325855:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58600/0xc3296956897c49c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.325861:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58600/0xc3296956897c49c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.325866:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac58600 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919123.325868:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58600/0xc3296956897c49c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.325874:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58600/0xc3296956897c49c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.325880:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88be853b5400) 00010000:00010000:0.0:1790919123.325882:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919123.325885:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58600/0xc3296956897c49c9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.325890:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58600/0xc3296956897c49c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919123.325967:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be83439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+47:10507:x1877914532497408:12345-192.168.201.27@tcp:34:lfs.0 Request processed in 593us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919123.325975:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 101 00000100:00100000:2.0:1790919123.369341:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919123.369520:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532497664 00000100:00100000:1.0:1790919123.369551:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532497664 00000100:00100000:1.0:1790919123.369619:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 102 00000100:00100000:1.0:1790919123.369629:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be83439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+47:10510:x1877914532497664:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:1.0:1790919123.369650:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919123.369671:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f600/0xc3296956897c49d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cd24 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.369745:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ea00/0xc3296956897c49d7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.369760:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ea00/0xc3296956897c49d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.369771:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ea00/0xc3296956897c49d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.369785:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7fe00/0xc3296956897c49de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.369793:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7fe00/0xc3296956897c49de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.369799:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7fe00/0xc3296956897c49de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.370197:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e000/0xc3296956897c49e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.370220:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e000/0xc3296956897c49e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.370227:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e000/0xc3296956897c49e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790919123.370238:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1790919123.370345:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ea00/0xc3296956897c49d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.370353:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ea00/0xc3296956897c49d7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.370360:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ea00/0xc3296956897c49d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.370367:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88beb3f7ea00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:1.0:1790919123.370371:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ea00/0xc3296956897c49d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.370379:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ea00/0xc3296956897c49d7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.370467:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88be8b621100) 00010000:00010000:1.0:1790919123.370471:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919123.370476:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ea00/0xc3296956897c49d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.370482:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ea00/0xc3296956897c49d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.370498:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7fe00/0xc3296956897c49de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.370513:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7fe00/0xc3296956897c49de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.370519:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7fe00/0xc3296956897c49de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.370523:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88beb3f7fe00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:1.0:1790919123.370631:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7fe00/0xc3296956897c49de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.370638:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7fe00/0xc3296956897c49de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.370647:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88be8b621a00) 00010000:00010000:1.0:1790919123.370650:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919123.370652:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7fe00/0xc3296956897c49de lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.370658:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7fe00/0xc3296956897c49de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.370705:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f600/0xc3296956897c49d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd24 expref: 50 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.370720:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e000/0xc3296956897c49e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd24 expref: 49 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.370727:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88be853b5400) 00010000:00010000:1.0:1790919123.370729:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790919123.370738:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88beb3f7e000, rc 0) 00000100:00100000:1.0:1790919123.370806:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be83439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+49:10510:x1877914532497664:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 1177us (1474us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1790919123.370814:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 102 00000100:00100000:2.0:1790919123.375938:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919123.376227:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532497792 00000100:00100000:0.0:1790919123.376238:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532497792 00000100:00100000:0.0:1790919123.376315:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 103 00000100:00100000:0.0:1790919123.376325:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be8343a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+49:10510:x1877914532497792:12345-192.168.201.27@tcp:54:lfs.0 00010000:00010000:0.0:1790919123.376688:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58e00/0xc3296956897c49f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.376724:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58e00/0xc3296956897c49f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.376739:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58e00/0xc3296956897c49f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.376769:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58e00/0xc3296956897c49f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.376776:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58e00/0xc3296956897c49f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.376784:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58e00/0xc3296956897c49f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.376791:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac58e00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919123.376795:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58e00/0xc3296956897c49f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.376802:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58e00/0xc3296956897c49f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.376816:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88be853b5400) 00010000:00010000:0.0:1790919123.376819:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790919123.376823:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58e00/0xc3296956897c49f3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.376829:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58e00/0xc3296956897c49f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919123.377008:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be8343a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+49:10510:x1877914532497792:12345-192.168.201.27@tcp:54:lfs.0 Request processed in 683us (1078us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919123.377023:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 103 00000100:00100000:0.0:1790919123.380875:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919123.380974:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532498048 00000100:00100000:2.0:1790919123.380984:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532498048 00000100:00100000:2.0:1790919123.381246:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 28 00000100:00100000:2.0:1790919123.381258:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebfbf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+49:10510:x1877914532498048:12345-192.168.201.27@tcp:35:lfs.0 00000100:00100000:2.0:1790919123.381518:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebfbf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+50:10510:x1877914532498048:12345-192.168.201.27@tcp:35:lfs.0 Request processed in 261us (653us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1790919123.381855:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 28 00000100:00100000:2.0:1790919123.455288:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919123.455383:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532498304 00000100:00100000:0.0:1790919123.455401:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532498304 00000100:00100000:0.0:1790919123.455463:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 104 00000100:00100000:0.0:1790919123.455473:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be83438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+50:10520:x1877914532498304:12345-192.168.201.27@tcp:101:bash.0 00010000:00010000:0.0:1790919123.455502:0:8231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919123.455506:0:8231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790919123.455582:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59600/0xc3296956897c4975 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd08 expref: 50 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.455602:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88be8b621100) 00010000:00010000:0.0:1790919123.455607:0:8231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790919123.455621:0:8231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58e00/0xc3296956897c49fa lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cd2b expref: -99 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.455724:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c4a01 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.455738:0:8231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e000/0xc3296956897c49e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd24 expref: 50 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.455746:0:8231:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c4a01 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.455778:0:8231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e000/0xc3296956897c49e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd24 expref: 50 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.455812:0:8231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e000/0xc3296956897c49e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd24 expref: 50 pid: 5845 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919123.455826:0:8231:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf6e0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8231:1877914550340736:192.168.201.27@tcp:104: 00000100:00100000:0.0:1790919123.455914:0:8231:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bebf6ac9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919123.460774:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919123.460883:0:8231:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf6e0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8231:1877914550340736:192.168.201.27@tcp:104: 00010000:00010000:2.0:1790919123.460915:0:8231:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c4a01 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919123.461141:0:8529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532498432 00000100:00100000:3.0:1790919123.461149:0:8529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532498432 00010000:00010000:3.0:1790919123.461186:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e000/0xc3296956897c49e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd24 expref: 51 pid: 5845 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919123.461231:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 52 00000100:00100000:3.0:1790919123.461240:0:8529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+51:2352:x1877914532498432:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919123.461257:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919123.461264:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e000/0xc3296956897c49e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd24 expref: 51 pid: 5845 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.461286:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e000/0xc3296956897c49e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd24 expref: 51 pid: 5845 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.461309:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e000/0xc3296956897c49e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd24 expref: 51 pid: 5845 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.461327:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88be853b5400) 00010000:00010000:3.0:1790919123.461332:0:8529:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c4a01 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.461341:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c4a01 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.461349:0:8529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c4a01 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.461429:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919123.461494:0:8529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+50:2352:x1877914532498432:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 254us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919123.461501:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 52 00010000:00010000:2.0:1790919123.463122:0:8231:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c4a01 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.463138:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c4a01 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919123.463163:0:8231:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1790919123.463358:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58e00/0xc3296956897c49fa lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd2b expref: 51 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.463379:0:8231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c4a01 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd2b expref: 50 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.463467:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88be853b5400) 00010000:00010000:2.0:1790919123.463471:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790919123.463474:0:8231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac59200, rc 0) 00000100:00100000:2.0:1790919123.463816:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be83438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+50:10520:x1877914532498304:12345-192.168.201.27@tcp:101:bash.0 Request processed in 8342us (8546us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1790919123.463826:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 104 00000100:00100000:0.0:1790919123.468501:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919123.468706:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532498688 00000100:00100000:3.0:1790919123.468727:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532498688 00000100:00100000:3.0:1790919123.468816:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 105 00000100:00100000:3.0:1790919123.468827:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+50:10520:x1877914532498688:12345-192.168.201.27@tcp:36:bash.0 00010000:00010000:3.0:1790919123.469103:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4a0f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.469121:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4a0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.469132:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4a0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790919123.469185:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:3.0:1790919123.469209:0:5847:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a1c6dde1 reply state 000000000786ff83 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4a0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919123.469218:0:5847:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790919123.469374:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+53:10520:x1877914532498688:12345-192.168.201.27@tcp:36:bash.0 Request processed in 547us (882us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1790919123.469382:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 105 00000020:00080000:3.0:1790919123.469397:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790919123.471780:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4a0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.471797:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4a0f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.471805:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4a0f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.471812:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81672c00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919123.471817:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4a0f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.471841:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4a0f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.471858:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88be853b5400) 00010000:00010000:3.0:1790919123.471862:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919123.471867:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4a0f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.471873:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4a0f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919123.475739:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919123.475917:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532498816 00000100:00100000:1.0:1790919123.475927:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532498816 00000100:00100000:1.0:1790919123.476053:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 106 00000100:00100000:1.0:1790919123.476063:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb413aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+52:10520:x1877914532498816:12345-192.168.201.27@tcp:101:bash.0 00010000:00010000:1.0:1790919123.476089:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919123.476109:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ea00/0xc3296956897c4a16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cd32 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.476190:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c4a1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.476204:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c4a01 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd2b expref: 53 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.476212:0:5845:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c4a1d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.476244:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c4a01 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd2b expref: 53 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.476257:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c4a01 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd2b expref: 53 pid: 8231 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919123.476282:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb40e1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1877914550340864:192.168.201.27@tcp:104: 00000100:00100000:1.0:1790919123.476386:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be995b9180 going to sleep for 11 seconds 00000100:00100000:0.0:1790919123.479416:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919123.479482:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532498944 00000100:00100000:3.0:1790919123.479492:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532498944 00010000:00010000:3.0:1790919123.479559:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c4a01 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd2b expref: 54 pid: 8231 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919123.479592:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 53 00000100:00100000:3.0:1790919123.479602:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4138e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+54:2353:x1877914532498944:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919123.479616:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919123.479624:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c4a01 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd2b expref: 54 pid: 8231 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.479637:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c4a01 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd2b expref: 54 pid: 8231 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.479659:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88be853b5400) 00010000:00010000:3.0:1790919123.479664:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c4a1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.479691:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c4a1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.479698:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c4a1d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.479717:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919123.479778:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4138e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+54:2353:x1877914532498944:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 177us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919123.479785:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 53 00010000:00010000:1.0:1790919123.480198:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c4a01 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd2b expref: 53 pid: 8231 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919123.480215:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb40e1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1877914550340864:192.168.201.27@tcp:104: 00010000:00010000:1.0:1790919123.480236:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c4a1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.480245:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c4a1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.480252:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c4a1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790919123.480303:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1790919123.480308:0:5845:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790919123.480327:0:5845:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c4a1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.480356:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ea00/0xc3296956897c4a16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd32 expref: 53 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.480372:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c4a1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd32 expref: 52 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.480379:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88be853b5400) 00010000:00010000:1.0:1790919123.480382:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790919123.480384:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88beb3f7e200, rc 0) 00000100:00100000:1.0:1790919123.480428:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb413aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+52:10520:x1877914532498816:12345-192.168.201.27@tcp:101:bash.0 Request processed in 4366us (4698us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919123.480442:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 106 00000100:00100000:0.0:1790919123.484920:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919123.485009:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532499200 00000100:00100000:3.0:1790919123.485028:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532499200 00000100:00100000:3.0:1790919123.485091:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 29 00000100:00100000:3.0:1790919123.485100:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb413ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+52:10520:x1877914532499200:12345-192.168.201.27@tcp:35:bash.0 00000100:00100000:3.0:1790919123.485352:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb413ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+53:10520:x1877914532499200:12345-192.168.201.27@tcp:35:bash.0 Request processed in 252us (442us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1790919123.485360:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 29 00000100:00100000:3.0:1790919123.541008:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919123.541193:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532499328 00000100:00100000:0.0:1790919123.541205:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532499328 00000100:00100000:0.0:1790919123.541287:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 107 00000100:00100000:0.0:1790919123.541299:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+53:10526:x1877914532499328:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:0.0:1790919123.541324:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919123.541345:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c4a24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cd39 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.541451:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c4a2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.541465:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c4a2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.541476:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c4a2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919123.541523:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1790919123.541554:0:5846:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790919123.541574:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c4a2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.541599:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c4a24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd39 expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.541616:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c4a2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd39 expref: 54 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.541625:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88be8b621100) 00010000:00010000:0.0:1790919123.541628:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790919123.541632:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac59400, rc 0) 00000100:00100000:0.0:1790919123.541698:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+54:10526:x1877914532499328:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 402us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919123.541707:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 107 00000100:00100000:0.0:1790919123.545680:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919123.545765:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532499456 00000100:00100000:2.0:1790919123.545775:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532499456 00000100:00100000:2.0:1790919123.545834:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 108 00000100:00100000:2.0:1790919123.545844:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb413b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+54:10526:x1877914532499456:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:2.0:1790919123.545866:0:8231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919123.545887:0:8231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4a32 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cd40 expref: -99 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.545964:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4a39 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.545978:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4a39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.545988:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4a39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.546003:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4a40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.546010:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4a40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.546030:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4a40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.546125:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c4a47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.546134:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c4a47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.546141:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c4a47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919123.546178:0:8231:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1790919123.546185:0:8231:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790919123.546202:0:8231:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c4a47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.546224:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c4a47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.546231:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4a39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.546237:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4a39 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.546243:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4a39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.546248:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386200 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919123.546252:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4a39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.546259:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4a39 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.546283:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88be8b621100) 00010000:00010000:2.0:1790919123.546286:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919123.546290:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4a39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.546295:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4a39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.546309:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4a40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.546314:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4a40 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.546327:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4a40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.546332:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386600 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919123.546334:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4a40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.546339:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4a40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.546347:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88be85efc000) 00010000:00010000:2.0:1790919123.546349:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919123.546352:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4a40 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.546356:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4a40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.546389:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4a32 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd40 expref: 56 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.546401:0:8231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c4a47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd40 expref: 55 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.546407:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88be853b5400) 00010000:00010000:2.0:1790919123.546409:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790919123.546411:0:8231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be88387c00, rc 0) 00000100:00100000:2.0:1790919123.546476:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb413b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+55:10526:x1877914532499456:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 633us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919123.546495:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 108 00000100:00100000:2.0:1790919123.551454:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919123.551502:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919123.551629:0:8529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532499584 00000100:00100000:3.0:1790919123.551641:0:8529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532499584 00000100:00100000:3.0:1790919123.551713:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 7 00000100:00100000:3.0:1790919123.551725:0:8529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be83438a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+55:2352:x1877914532499584:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919123.551740:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919123.551764:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c4a47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd40 expref: 55 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.551801:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88be853b5400) 00010000:00010000:3.0:1790919123.551806:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919123.551879:0:8529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be83438a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+54:2352:x1877914532499584:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 156us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919123.551887:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 7 00000100:00100000:0.0:1790919123.551957:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532499840 00000100:00100000:0.0:1790919123.551961:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532499840 00000100:00100000:0.0:1790919123.552000:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 109 00000100:00100000:0.0:1790919123.552008:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+54:10526:x1877914532499840:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:0.0:1790919123.552035:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919123.552051:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c4a4e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cd47 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.552150:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4a55 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.552172:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c4a1d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd32 expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.552181:0:5846:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4a55 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.552216:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c4a1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd32 expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.552230:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c4a1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd32 expref: 55 pid: 5845 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919123.552244:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb413bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877914550340992:192.168.201.27@tcp:104: 00000100:00100000:0.0:1790919123.552315:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bebf6ac780 going to sleep for 11 seconds 00000100:00100000:0.0:1790919123.555670:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb413bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877914550340992:192.168.201.27@tcp:104: 00010000:00010000:0.0:1790919123.555702:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4a55 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919123.557146:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919123.557468:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532499968 00000100:00100000:3.0:1790919123.557477:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532499968 00010000:00010000:3.0:1790919123.557512:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c4a1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd32 expref: 56 pid: 5845 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919123.557591:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 54 00000100:00100000:3.0:1790919123.557602:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be91cad050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+56:2352:x1877914532499968:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919123.557617:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919123.557625:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c4a1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd32 expref: 56 pid: 5845 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.557637:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c4a1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd32 expref: 56 pid: 5845 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.557658:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c4a1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd32 expref: 56 pid: 5845 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.557677:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88be853b5400) 00010000:00010000:3.0:1790919123.557682:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4a55 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.557711:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4a55 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.557719:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4a55 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.557750:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919123.557805:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be91cad050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+55:2352:x1877914532499968:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 205us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919123.557813:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 54 00010000:00010000:2.0:1790919123.558795:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4a55 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.558807:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4a55 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919123.558828:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1790919123.558993:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c4a4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd47 expref: 56 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.559011:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4a55 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd47 expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.559035:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88be853b5400) 00010000:00010000:2.0:1790919123.559038:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790919123.559041:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac59000, rc 0) 00000100:00100000:2.0:1790919123.559152:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+55:10526:x1877914532499840:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 7145us (7649us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1790919123.559161:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 109 00000100:00100000:2.0:1790919123.562649:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919123.562781:0:8529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532500224 00000100:00100000:3.0:1790919123.562791:0:8529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532500224 00000100:00100000:3.0:1790919123.562856:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 8 00000100:00100000:3.0:1790919123.562865:0:8529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+55:10526:x1877914532500224:12345-192.168.201.27@tcp:103:lfs.0 00010000:00010000:3.0:1790919123.562881:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919123.562908:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c49b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd1d expref: 55 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.562927:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88be853b5400) 00010000:00010000:3.0:1790919123.562932:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919123.563150:0:8529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+54:10526:x1877914532500224:12345-192.168.201.27@tcp:103:lfs.0 Request processed in 284us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919123.563158:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 8 00000100:00100000:3.0:1790919123.568588:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919123.568752:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532500352 00000100:00100000:2.0:1790919123.568763:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532500352 00000100:00100000:2.0:1790919123.568821:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 110 00000100:00100000:2.0:1790919123.568832:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+54:10526:x1877914532500352:12345-192.168.201.27@tcp:58:lfs.0 00010000:00010000:2.0:1790919123.568950:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4a63 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.568968:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4a63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.568978:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4a63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790919123.569326:0:8231:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1790919123.569560:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+54:10526:x1877914532500352:12345-192.168.201.27@tcp:58:lfs.0 Request processed in 729us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919123.569569:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 110 00000100:00100000:1.0:1790919123.573909:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919123.573987:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532500480 00000100:00100000:3.0:1790919123.573998:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532500480 00000100:00100000:3.0:1790919123.574106:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 111 00000100:00100000:3.0:1790919123.574130:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb40e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+54:10526:x1877914532500480:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:3.0:1790919123.574153:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919123.574175:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4a6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cd4e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.574237:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4a63 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.574248:0:5847:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4a6a lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd4e expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.574276:0:5847:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4a63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.574290:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4a6a lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd4e expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.574304:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88be853b5400) 00010000:00010000:3.0:1790919123.574307:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790919123.574311:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4a6a lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd4e expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.574319:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81672e00, rc 0) 00000100:00100000:3.0:1790919123.574392:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb40e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+55:10526:x1877914532500480:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 256us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919123.574399:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 111 00000040:00080000:1.0:1790919123.647946:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790919123.647956:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790919123.647995:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1790919123.648004:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790919123.648138:0:11708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb40e3800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11708:1877914550341120:192.168.201.27@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790919123.648246:0:11708:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be995b9840 going to sleep for 11 seconds 00000100:00100000:1.0:1790919123.652431:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919123.652684:0:11708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb40e3800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11708:1877914550341120:192.168.201.27@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790919123.652896:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532500608 00000100:00100000:0.0:1790919123.652905:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532500608 00000100:00100000:0.0:1790919123.652964:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 112 00000100:00100000:0.0:1790919123.652976:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb40e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+55:10527:x1877914532500608:12345-192.168.201.27@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790919123.653009:0:5845:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790919123.653115:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb40e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+55:10527:x1877914532500608:12345-192.168.201.27@tcp:53:lhsmtool_posix.0 Request processed in 142us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919123.653123:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 112 00000100:00100000:0.0:1790919123.659751:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919123.659855:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532500736 00000100:00100000:2.0:1790919123.659866:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532500736 00000100:00100000:2.0:1790919123.659925:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 113 00000100:00100000:2.0:1790919123.659936:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb413bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+55:10527:x1877914532500736:12345-192.168.201.27@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1790919123.660026:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4a71 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.660053:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4a71 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.660066:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4a71 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.660082:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4a78 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.660109:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4a78 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.660116:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4a78 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.660141:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4a7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.660149:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4a7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.660156:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4a7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919123.660195:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1790919123.660199:0:5846:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790919123.660213:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4a7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.660224:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4a71 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.660230:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4a71 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.660238:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4a71 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.660244:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386600 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919123.660248:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4a71 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.660263:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4a71 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.660284:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88be85efcb00) 00010000:00010000:2.0:1790919123.660287:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919123.660292:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4a71 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.660298:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4a71 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.660314:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4a78 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.660320:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4a78 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.660326:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4a78 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.660331:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386200 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919123.660334:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4a78 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.660340:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4a78 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.660347:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff88be85efc000) 00010000:00010000:2.0:1790919123.660350:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919123.660352:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4a78 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.660368:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4a78 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.660384:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4a7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.660390:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4a7f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.660395:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4a7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.660400:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386c00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919123.660403:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4a7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.660409:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4a7f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.660416:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88be853b5400) 00010000:00010000:2.0:1790919123.660418:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919123.660420:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4a7f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.660425:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4a7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919123.660502:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb413bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+55:10527:x1877914532500736:12345-192.168.201.27@tcp:34:lhsmtool_posix.0 Request processed in 567us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919123.660510:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 113 00000100:00100000:1.0:1790919123.663962:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919123.664016:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919123.664041:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919123.664075:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919123.664131:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532500864 00000100:00100000:2.0:1790919123.664140:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532500864 00000100:00100000:2.0:1790919123.664188:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 289 00000100:00100000:2.0:1790919123.664196:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+13:2351:x1877914532500864:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:2.0:1790919123.664259:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+13:2351:x1877914532500864:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 64us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919123.664276:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 289 00000100:00100000:0.0:1790919123.664361:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532501120 00000100:00100000:0.0:1790919123.664366:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532501120 00000100:00100000:0.0:1790919123.664400:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532500992 00000100:00100000:0.0:1790919123.664403:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532500992 00000100:00100000:0.0:1790919123.664425:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 76 00000100:00100000:0.0:1790919123.664432:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb40e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:2351:x1877914532501120:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:0.0:1790919123.664462:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb40e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:2351:x1877914532501120:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 30us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919123.664469:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 76 00000100:00100000:0.0:1790919123.664488:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 77 00000100:00100000:0.0:1790919123.664495:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb40e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+8:2351:x1877914532500992:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:0.0:1790919123.664520:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb40e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+8:2351:x1877914532500992:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 26us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919123.664560:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 77 00000100:00100000:1.0:1790919123.665227:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532501248 00000100:00100000:1.0:1790919123.665234:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532501248 00000100:00100000:1.0:1790919123.665341:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 137 00000100:00100000:1.0:1790919123.665352:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb40e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5591729f-44f1-43f1-b042-c3a508737d97+5:2351:x1877914532501248:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:1.0:1790919123.665412:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb40e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5591729f-44f1-43f1-b042-c3a508737d97+5:2351:x1877914532501248:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 63us (1335us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919123.665419:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 137 00000100:00080000:0.0:1790919123.665745:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790919123.668298:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919123.668374:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532501504 00000100:00100000:2.0:1790919123.668467:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532501504 00000100:00100000:2.0:1790919123.668565:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 114 00000100:00100000:2.0:1790919123.668576:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb40e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+55:10527:x1877914532501504:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790919123.668603:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919123.668626:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c4a86 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cd55 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.668724:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4a8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.668740:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4a8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.668751:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4a8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919123.668762:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1790919123.669232:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4a8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.669243:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4a8d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.669276:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4a8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.669284:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88387200 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919123.669288:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4a8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.669297:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4a8d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.669310:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88be853b5400) 00010000:00010000:2.0:1790919123.669313:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790919123.669317:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4a8d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.669323:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4a8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.669368:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c4a86 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd55 expref: 57 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.669379:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88be85efcb00) 00010000:00010000:2.0:1790919123.669470:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790919123.669476:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c4a86 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd55 expref: 57 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.669487:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be88386e00, rc 0) 00000100:00100000:2.0:1790919123.669688:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb40e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+56:10527:x1877914532501504:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 1113us (1399us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1790919123.669708:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 114 00000100:00100000:3.0:1790919123.674628:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919123.674826:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532501632 00000100:00100000:2.0:1790919123.674836:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532501632 00000100:00100000:2.0:1790919123.675029:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 115 00000100:00100000:2.0:1790919123.675042:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+56:10527:x1877914532501632:12345-192.168.201.27@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790919123.675111:0:8231:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790919123.675235:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+56:10527:x1877914532501632:12345-192.168.201.27@tcp:53:lhsmtool_posix.0 Request processed in 195us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919123.679947:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919123.680362:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532501888 00000100:00100000:3.0:1790919123.680386:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532501888 00000100:00100000:2.0:1790919123.684491:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 115 00000100:00100000:3.0:1790919123.687716:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 116 00000100:00100000:3.0:1790919123.687742:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4138e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+56:10527:x1877914532501888:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790919123.687768:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919123.687772:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1790919123.687801:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c4a2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd39 expref: 56 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.687822:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88be8b621100) 00010000:00010000:3.0:1790919123.687827:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790919123.687842:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4a9b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cd5c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790919123.688477:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1790919123.689090:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4aa2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.689105:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4aa2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.689116:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4aa2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.689176:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4a9b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd5c expref: 58 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.689194:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4aa2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd5c expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.689219:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88be88e22100) 00010000:00010000:3.0:1790919123.689222:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790919123.689225:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81673800, rc 0) 00000100:00100000:3.0:1790919123.689364:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4138e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+57:10527:x1877914532501888:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 1635us (9426us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1790919123.689373:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 116 00000100:00100000:3.0:1790919123.695258:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919123.695497:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532502144 00000100:00100000:1.0:1790919123.695511:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532502144 00000100:00100000:0.0:1790919123.695973:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 117 00000100:00100000:0.0:1790919123.695986:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+57:10527:x1877914532502144:12345-192.168.201.27@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790919123.696059:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919123.696087:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4aa2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd5c expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.696110:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88be88e22100) 00010000:00010000:0.0:1790919123.696121:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790919123.696143:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c4ab0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.696171:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c4ab0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.696181:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c4ab0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.696250:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c4ab7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xfee2252b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.696257:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c4ab7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xfee2252b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.696281:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c4ab7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xfee2252b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.696346:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c4ab0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.696354:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c4ab0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.696361:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c4ab0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.696367:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac58a00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919123.696371:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c4ab0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.696379:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c4ab0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.696396:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88be8b621100) 00010000:00010000:0.0:1790919123.696404:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919123.696409:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c4ab0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.696416:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c4ab0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.696426:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c4ab7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xfee2252b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.696432:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c4ab7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xfee2252b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.696438:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c4ab7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xfee2252b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.696443:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac59800 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919123.696446:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c4ab7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xfee2252b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.696451:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c4ab7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xfee2252b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.696458:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xfee2252b (ffff88be853b5d00) 00010000:00010000:0.0:1790919123.696460:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919123.696462:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c4ab7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xfee2252b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.696467:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c4ab7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xfee2252b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919123.696995:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+56:10527:x1877914532502144:12345-192.168.201.27@tcp:36:lhsmtool_posix.0 Request processed in 1010us (1745us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790919123.697008:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 117 00000100:00100000:1.0:1790919123.701717:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919123.701867:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532502272 00000100:00100000:2.0:1790919123.701877:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532502272 00000100:00100000:2.0:1790919123.701937:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 118 00000100:00100000:2.0:1790919123.701947:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb40e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+56:10527:x1877914532502272:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790919123.701968:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919123.701991:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c4abe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cd63 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.702036:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4ac5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.702050:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.702060:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.702160:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c4abe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd63 expref: 58 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.702187:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4ac5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd63 expref: 57 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.702196:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88be85efc000) 00010000:00010000:2.0:1790919123.702199:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790919123.702203:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be88387200, rc 0) 00000100:00100000:2.0:1790919123.702335:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb40e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+57:10527:x1877914532502272:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 389us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919123.702344:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 118 00000100:00100000:1.0:1790919123.706918:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919123.707057:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532502528 00000100:00100000:2.0:1790919123.707069:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532502528 00000100:00100000:2.0:1790919123.707133:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 119 00000100:00100000:2.0:1790919123.707144:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb40e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+57:10527:x1877914532502528:12345-192.168.201.27@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790919123.707225:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4acc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.707243:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4acc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.707254:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4acc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790919123.707556:0:8231:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00010000:2.0:1790919123.707642:0:8231:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000033360805 reply state 0000000035602fb2 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4acc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919123.707653:0:8231:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790919123.707768:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb40e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+59:10527:x1877914532502528:12345-192.168.201.27@tcp:36:lhsmtool_posix.0 Request processed in 625us (865us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1790919123.707776:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 119 00000100:00100000:1.0:1790919123.711050:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919123.711192:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532502656 00000100:00100000:0.0:1790919123.711204:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532502656 00000100:00100000:0.0:1790919123.711259:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 120 00000100:00100000:0.0:1790919123.711281:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb40e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+59:10527:x1877914532502656:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790919123.711304:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919123.711324:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c4ad3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cd6a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.711400:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c4ad3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd6a expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.711417:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c4ad3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd6a expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.711441:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88be85efc000) 00010000:00010000:0.0:1790919123.711444:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790919123.711448:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac59800, rc 0) 00000100:00100000:0.0:1790919123.711520:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb40e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+60:10527:x1877914532502656:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 241us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919123.711544:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 120 00010000:00010000:2.0:1790919123.711755:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4acc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.711765:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4acc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.711772:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4acc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.711777:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386c00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919123.711782:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4acc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.711790:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4acc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.711801:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88be85efc000) 00010000:00010000:2.0:1790919123.711804:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790919123.711807:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4acc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.711813:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4acc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919123.714729:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919123.714804:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532502784 00000100:00100000:3.0:1790919123.714813:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532502784 00000100:00100000:3.0:1790919123.714870:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 37 00000100:00100000:3.0:1790919123.714880:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb40e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+8:2353:x1877914532502784:12345-192.168.201.27@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1790919123.715332:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb40e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+9:2353:x1877914532502784:12345-192.168.201.27@tcp:2:lhsmtool_posix.0 Request processed in 453us (611us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1790919123.715341:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 37 00000100:00100000:0.0:1790919123.717958:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919123.718136:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532503040 00000100:00100000:2.0:1790919123.718147:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532503040 00000100:00100000:2.0:1790919123.718210:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 30 00000100:00100000:2.0:1790919123.718221:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+59:10527:x1877914532503040:12345-192.168.201.27@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790919123.718556:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+60:10527:x1877914532503040:12345-192.168.201.27@tcp:35:lhsmtool_posix.0 Request processed in 336us (607us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1790919123.718564:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 30 00000100:00100000:3.0:1790919123.720697:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919123.721484:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532503296 00000100:00100000:2.0:1790919123.721497:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532503296 00000100:00100000:2.0:1790919123.721584:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 121 00000100:00100000:2.0:1790919123.721595:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+60:10527:x1877914532503296:12345-192.168.201.27@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790919123.721702:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+60:10527:x1877914532503296:12345-192.168.201.27@tcp:57:lhsmtool_posix.0 Request processed in 108us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919123.721710:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 121 00000100:00100000:3.0:1790919123.725243:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919123.725396:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532503424 00000100:00100000:0.0:1790919123.725406:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532503424 00000100:00100000:0.0:1790919123.725465:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 122 00000100:00100000:0.0:1790919123.725477:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+60:10527:x1877914532503424:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790919123.725518:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919123.725574:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c4ada lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cd71 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.725646:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4ae1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.725662:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4ae1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.725673:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4ae1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919123.725712:0:5846:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790919123.725733:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4ae1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.725760:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c4ada lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd71 expref: 62 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.725779:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4ae1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd71 expref: 61 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.725788:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88be85efc000) 00010000:00010000:0.0:1790919123.725791:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1790919123.725795:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac59e00, rc 0) 00000100:00100000:0.0:1790919123.725910:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+61:10527:x1877914532503424:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 435us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919123.725919:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 122 00000100:00100000:1.0:1790919123.729891:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919123.729992:0:10350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532503552 00000100:00100000:2.0:1790919123.730002:0:10350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532503552 00000100:00100000:2.0:1790919123.730071:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 38 00000100:00100000:2.0:1790919123.730081:0:10350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb40e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+9:2353:x1877914532503552:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790919123.730102:0:10350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919123.730124:0:10350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d928183b/0xc3296956897c4ae8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cd78 expref: -99 pid: 10350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790919123.730153:0:10350:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abf41d4, blocks: 0x1 00010000:00010000:2.0:1790919123.730173:0:10350:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=325s v=(0 0) 00010000:00010000:2.0:1790919123.730178:0:10350:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919123.730187:0:10350:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d928183b/0xc3296956897c4ae8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd78 expref: 10 pid: 10350 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.730204:0:10350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d928183b/0xc3296956897c4ae8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd78 expref: 10 pid: 10350 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.730233:0:10350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be88386200, rc 0) 00000100:00100000:2.0:1790919123.730347:0:10350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb40e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+10:2353:x1877914532503552:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 267us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919123.730355:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 38 00000100:00100000:2.0:1790919123.733665:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919123.733785:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532503808 00000100:00100000:0.0:1790919123.733797:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532503808 00000100:00100000:0.0:1790919123.733861:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 123 00000100:00100000:0.0:1790919123.733871:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+61:10527:x1877914532503808:12345-192.168.201.27@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790919123.734038:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+61:10527:x1877914532503808:12345-192.168.201.27@tcp:57:lhsmtool_posix.0 Request processed in 167us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919123.734047:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 123 00000100:00100000:0.0:1790919123.737116:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919123.737190:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532503936 00000100:00100000:1.0:1790919123.737200:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532503936 00000100:00100000:1.0:1790919123.737300:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 39 00000100:00100000:1.0:1790919123.737311:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+10:10527:x1877914532503936:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790919123.737330:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919123.737348:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c97af259/0xc3296956897c4aef lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cd7f expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.737388:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d928183b/0xc3296956897c4ae8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd78 expref: 11 pid: 10350 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.737397:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919123.737402:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919123.737407:0:6699:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c97af259/0xc3296956897c4aef lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd7f expref: 11 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.737444:0:6699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d928183b/0xc3296956897c4ae8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd78 expref: 11 pid: 10350 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.737459:0:6699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d928183b/0xc3296956897c4ae8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd78 expref: 11 pid: 10350 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919123.737474:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb40e0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6699:1877914550341248:192.168.201.27@tcp:104: 00000100:00100000:1.0:1790919123.737592:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be995b9840 going to sleep for 11 seconds 00000100:00100000:1.0:1790919123.741074:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919123.741154:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532504064 00000100:00100000:3.0:1790919123.741164:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532504064 00010000:00010000:3.0:1790919123.741201:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d928183b/0xc3296956897c4ae8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd78 expref: 12 pid: 10350 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919123.741243:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 55 00000100:00100000:3.0:1790919123.741253:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb40e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+12:2353:x1877914532504064:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919123.741280:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919123.741317:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d928183b/0xc3296956897c4ae8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd78 expref: 12 pid: 10350 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.741330:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d928183b/0xc3296956897c4ae8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd78 expref: 12 pid: 10350 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.741356:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919123.741360:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919123.741368:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c97af259/0xc3296956897c4aef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd7f expref: 12 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.741390:0:5829:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c97af259/0xc3296956897c4aef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd7f expref: 12 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.741425:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c97af259/0xc3296956897c4aef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd7f expref: 12 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919123.741438:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb4267480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5829:1877914550341376:192.168.201.27@tcp:105: 00000100:00100000:3.0:1790919123.741520:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bebfbc9840 going to sleep for 11 seconds 00000100:00100000:3.0:1790919123.743996:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb4267480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5829:1877914550341376:192.168.201.27@tcp:105: 00010000:00010000:3.0:1790919123.744029:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919123.744099:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb40e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+12:2353:x1877914532504064:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 2846us (3034us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919123.744111:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 55 00010000:00010000:0.0:1790919123.745207:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d928183b/0xc3296956897c4ae8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd78 expref: 11 pid: 10350 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919123.745227:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb40e0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6699:1877914550341248:192.168.201.27@tcp:104: 00010000:00010000:0.0:1790919123.745259:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c97af259/0xc3296956897c4aef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd7f expref: 10 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.745283:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88beb3f7f800, rc 0) 00000100:00100000:0.0:1790919123.745367:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+10:10527:x1877914532503936:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 8058us (8261us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919123.745375:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 39 00000100:00100000:2.0:1790919123.749848:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919123.749924:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532504192 00000100:00100000:1.0:1790919123.749935:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532504192 00002000:00100000:1.0:1790919123.749988:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff88beb0b1ed80 x1877914532504192/t0(0) o4->c4a4e085-55d7-40e9-993c-11b4dfc2d5f5@192.168.201.27@tcp:244/0 lens 504/0 e 0 to 0 dl 1790919134 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790919123.750000:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88beb0b1ed80 with x1877914532504192 ext(0->12) 00002000:00010000:1.0:1790919123.750006:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88beb0b1ed80 00000100:00100000:1.0:1790919123.750052:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 2 00000100:00100000:1.0:1790919123.750063:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+10:2352:x1877914532504192:12345-192.168.201.27@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1790919123.751146:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+12:2352:x1877914532504192:12345-192.168.201.27@tcp:4:lhsmtool_posix.0 Request processed in 1078us (1301us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1790919123.751157:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 2 00002000:00100000:1.0:1790919123.751166:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff88beb0b1ed80 x1877914532504192/t4294967308(0) o4->c4a4e085-55d7-40e9-993c-11b4dfc2d5f5@192.168.201.27@tcp:244/0 lens 504/448 e 0 to 0 dl 1790919134 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790919123.751176:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88beb0b1ed80 with x1877914532504192 ext(0->12) 00002000:00010000:1.0:1790919123.751181:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88beb0b1ed80 00000100:00100000:2.0:1790919123.754764:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919123.754874:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532504320 00000100:00100000:0.0:1790919123.754885:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532504320 00000100:00100000:0.0:1790919123.754983:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 124 00000100:00100000:0.0:1790919123.754994:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+61:10527:x1877914532504320:12345-192.168.201.27@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1790919123.791000:0:5869:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967388 is committed 00000004:00080000:0.0:1790919123.791024:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:0.0:1790919123.791066:0:5869:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88be90e4af00 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1790919123.791072:0:5869:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88be82aa9a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88be90e4a600 00000020:00080000:0.0:1790919123.791075:0:5869:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88be82aa9c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88beba6a4000 00000001:00080000:0.0:1790919123.791114:0:5869:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967390 is committed 00000001:00080000:0.0:1790919123.791132:0:5869:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:0.0:1790919123.791146:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1790919123.791176:0:5869:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88be84c9d000 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1790919123.791179:0:5869:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88be9261d400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88be84c9dcc0 00000020:00080000:0.0:1790919123.791182:0:5869:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88be9261de00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88beb40e4400 00000020:00080000:0.0:1790919123.791275:0:5880:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:1.0:1790919123.791598:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790919123.791617:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb40e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550341504:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1790919123.791687:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1790919123.791881:0:5880:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1790919123.791965:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550341632:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1790919123.791997:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919123.792057:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550341504 00000100:00100000:0.0:1790919123.792064:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550341504 00000100:00100000:0.0:1790919123.792104:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550341632 00000100:00100000:0.0:1790919123.792107:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550341632 00000100:00100000:0.0:1790919123.792128:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790919123.792137:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be85f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1877914550341504:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1790919123.792164:0:6700:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:0.0:1790919123.792199:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6abf41d3, atime: 0x6abf41d3, ctime: 0x6abf41d3, blocks: 0x1 00010000:00010000:0.0:1790919123.792207:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000439bf1b2/0xc3296956897c4af6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.792223:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=325s v=(0 0) 00010000:00010000:0.0:1790919123.792228:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919123.792245:0:6700:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000439bf1b2/0xc3296956897c4af6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.792274:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000439bf1b2/0xc3296956897c4af6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.792286:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000439bf1b2/0xc3296956897c4af6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.792294:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000439bf1b2/0xc3296956897c4af6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.792518:0:6700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790919123.793017:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be85f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3305:x1877914550341504:12345-0@lo:6:osp-syn-1-0.0 Request processed in 878us (1327us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1790919123.793025:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790919123.793064:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790919123.793073:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1877914550341632:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1790919123.793091:0:6700:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:0.0:1790919123.793109:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007beff5c6/0xc3296956897c4afd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.793128:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641ed173/0xc3296956897c48b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccde expref: 11 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.793136:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1790919123.793140:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790919123.793152:0:6700:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007beff5c6/0xc3296956897c4afd lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.793181:0:6700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000641ed173/0xc3296956897c48b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccde expref: 11 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.793196:0:6700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000641ed173/0xc3296956897c48b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccde expref: 11 pid: 6700 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919123.793211:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b3ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6700:1877914550341760:192.168.201.27@tcp:104: 00000100:00100000:0.0:1790919123.793293:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bebf6ac9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790919123.793852:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+15:10527:x1877914532504320:12345-192.168.201.27@tcp:44:lhsmtool_posix.0 Request processed in 38857us (39096us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919123.793873:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 124 00010000:00010000:1.0:1790919123.793948:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919123.793956:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000439bf1b2/0xc3296956897c4af6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.793965:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac59200 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:1.0:1790919123.793969:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000439bf1b2/0xc3296956897c4af6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.793986:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000439bf1b2/0xc3296956897c4af6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.794005:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000439bf1b2/0xc3296956897c4af6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.794018:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000439bf1b2/0xc3296956897c4af6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.794040:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919123.794042:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919123.794044:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1790919123.794221:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88beb40e0e00/2, rc 0, transno 4294967304 00000100:00100000:0.0:1790919123.794229:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb40e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550341504:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1790919123.800258:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919123.800354:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919123.800485:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532504576 00000100:00100000:3.0:1790919123.800497:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532504576 00000100:00100000:3.0:1790919123.800571:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 42 00000100:00100000:3.0:1790919123.800582:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be85f38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+12:2352:x1877914532504576:12345-192.168.201.27@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1790919123.800691:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532504448 00000100:00100000:2.0:1790919123.800696:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532504448 00010000:00010000:2.0:1790919123.800724:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000641ed173/0xc3296956897c48b8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccde expref: 13 pid: 6700 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919123.800756:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 56 00000100:00100000:2.0:1790919123.800764:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be85f38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+13:2353:x1877914532504448:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790919123.800776:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919123.800783:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000641ed173/0xc3296956897c48b8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccde expref: 13 pid: 6700 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.800797:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000641ed173/0xc3296956897c48b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccde expref: 13 pid: 6700 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.800822:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790919123.800827:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790919123.800834:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007beff5c6/0xc3296956897c4afd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.800858:0:5830:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007beff5c6/0xc3296956897c4afd lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.800882:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919123.800936:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be85f38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+13:2353:x1877914532504448:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 172us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919123.800943:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 56 00010000:00010000:0.0:1790919123.802908:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641ed173/0xc3296956897c48b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccde expref: 12 pid: 6700 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919123.802930:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b3ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6700:1877914550341760:192.168.201.27@tcp:104: 00010000:00010000:0.0:1790919123.802954:0:6700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007beff5c6/0xc3296956897c4afd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.802966:0:6700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007beff5c6/0xc3296956897c4afd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.802973:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007beff5c6/0xc3296956897c4afd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.803003:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007beff5c6/0xc3296956897c4afd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.803078:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007beff5c6/0xc3296956897c4afd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.803107:0:6700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790919123.803467:0:7650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790919123.803475:0:7650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007beff5c6/0xc3296956897c4afd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.803484:0:7650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac58e00 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:3.0:1790919123.803489:0:7650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007beff5c6/0xc3296956897c4afd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.803498:0:7650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007beff5c6/0xc3296956897c4afd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.803518:0:7650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007beff5c6/0xc3296956897c4afd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.803545:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007beff5c6/0xc3296956897c4afd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.803565:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919123.803566:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919123.803568:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1790919123.804147:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88beb3b39180/2, rc 0, transno 4294967309 00000100:00100000:2.0:1790919123.804171:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550341632:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1790919123.804718:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3307:x1877914550341632:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10932us (12005us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1790919123.804731:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000001:00080000:1.0:1790919123.839376:0:6722:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:1.0:1790919123.839403:0:6722:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:1.0:1790919123.839411:0:6722:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:3.0:1790919123.839892:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be85f38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2352:x1877914532504576:12345-192.168.201.27@tcp:16:lhsmtool_posix.0 Request processed in 39305us (39531us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919123.839918:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 42 00000100:00100000:1.0:1790919123.844748:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919123.844853:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532504832 00000100:00100000:0.0:1790919123.844864:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532504832 00000100:00100000:0.0:1790919123.844919:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 125 00000100:00100000:0.0:1790919123.844929:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+15:10527:x1877914532504832:12345-192.168.201.27@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790919123.844986:0:8231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919123.845024:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4ae1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd71 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.845055:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88be85efc000) 00010000:00010000:0.0:1790919123.845060:0:8231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790919123.845091:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4b04 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.845106:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4b04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.845137:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4b04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790919123.845725:0:8231:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000037aa7494 reply state 0000000052d80e45 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4b04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919123.845737:0:8231:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790919123.845838:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+16:10527:x1877914532504832:12345-192.168.201.27@tcp:36:lhsmtool_posix.0 Request processed in 909us (1098us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1790919123.845847:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 125 00000100:00100000:1.0:1790919123.854518:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00010000:00010000:3.0:1790919123.854698:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4b04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.854712:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4b04 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.854721:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4b04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.854727:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac59a00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919123.854733:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4b04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.854741:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4b04 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.854758:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88be85efc000) 00010000:00010000:3.0:1790919123.854761:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919123.854766:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4b04 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.854772:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4b04 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919123.854940:0:10350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532504960 00000100:00100000:2.0:1790919123.854951:0:10350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532504960 00000100:00100000:2.0:1790919123.855100:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 43 00000100:00100000:2.0:1790919123.855112:0:10350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba026d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2350:x1877914532504960:12345-192.168.201.27@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1790919123.855393:0:10350:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1790919123.855397:0:10350:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1790919124 00002000:00010000:2.0:1790919123.855399:0:10350:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1790919123 00002000:00010000:2.0:1790919123.855402:0:10350:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1790919124 -> 1790919124 00002000:00010000:2.0:1790919123.855404:0:10350:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1790919123.855467:0:10350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba026d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:2350:x1877914532504960:12345-192.168.201.27@tcp:2:lhsmtool_posix.0 Request processed in 356us (959us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1790919123.855474:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 43 00000100:00100000:0.0:1790919123.858353:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919123.858494:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532505216 00000100:00100000:3.0:1790919123.858505:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532505216 00000100:00100000:3.0:1790919123.858591:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 126 00000100:00100000:3.0:1790919123.858601:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+15:10527:x1877914532505216:12345-192.168.201.27@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1790919123.858677:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4b0b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.858709:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4ac5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd63 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.858718:0:5847:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4b0b lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.858752:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4ac5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd63 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.858766:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4ac5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd63 expref: 15 pid: 5846 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919123.858782:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb4267480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1877914550341888:192.168.201.27@tcp:104: 00000100:00100000:3.0:1790919123.858875:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bebfbc9840 going to sleep for 11 seconds 00000100:00100000:3.0:1790919123.863992:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919123.864279:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb4267480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1877914550341888:192.168.201.27@tcp:104: 00010000:00010000:0.0:1790919123.864317:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4b0b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919123.864570:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532505344 00000100:00100000:1.0:1790919123.864580:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532505344 00010000:00010000:1.0:1790919123.864620:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4ac5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd63 expref: 16 pid: 5846 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919123.864654:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 57 00000100:00100000:1.0:1790919123.864664:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4266680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+16:2353:x1877914532505344:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790919123.864696:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919123.864704:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4ac5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd63 expref: 16 pid: 5846 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.864715:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4ac5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd63 expref: 16 pid: 5846 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.864738:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4ac5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd63 expref: 16 pid: 5846 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.864754:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88be85efc000) 00010000:00010000:1.0:1790919123.864758:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4b0b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.864767:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4b0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.864775:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4b0b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.864801:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919123.864851:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4266680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+15:2353:x1877914532505344:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 187us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919123.864858:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 57 00010000:00010000:1.0:1790919123.864883:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4b0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.864890:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4b0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.864930:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4b0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.864937:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4b0b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.864943:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4b0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.864949:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81672c00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:1.0:1790919123.864953:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4b0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.864960:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4b0b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.864969:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88be85efc000) 00010000:00010000:1.0:1790919123.864971:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1790919123.864976:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4b0b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.864982:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4b0b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919123.865258:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+14:10527:x1877914532505216:12345-192.168.201.27@tcp:55:lhsmtool_posix.0 Request processed in 6658us (6916us total) trans 0 rc -22/-22 00000100:00100000:1.0:1790919123.865278:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 126 00000100:00100000:1.0:1790919123.869605:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919123.869880:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532505472 00000100:00100000:0.0:1790919123.869892:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532505472 00000100:00100000:0.0:1790919123.869949:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 44 00000100:00100000:0.0:1790919123.869959:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba027800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:2352:x1877914532505472:12345-192.168.201.27@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1790919123.870004:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000057551289/0xc3296956897c4b12 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.870036:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c97af259/0xc3296956897c4aef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd7f expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.870046:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919123.870051:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790919123.870074:0:6700:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057551289/0xc3296956897c4b12 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.870115:0:6700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c97af259/0xc3296956897c4aef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd7f expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.870131:0:6700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c97af259/0xc3296956897c4aef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd7f expref: 7 pid: 6699 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919123.870146:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b39880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6700:1877914550342016:192.168.201.27@tcp:104: 00000100:00100000:0.0:1790919123.870226:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bebf6ac780 going to sleep for 11 seconds 00000100:00100000:0.0:1790919123.877455:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919123.878424:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b39880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6700:1877914550342016:192.168.201.27@tcp:104: 00010000:00010000:3.0:1790919123.878454:0:6700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000057551289/0xc3296956897c4b12 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919123.878636:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532505600 00000100:00100000:2.0:1790919123.878644:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532505600 00010000:00010000:2.0:1790919123.878685:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c97af259/0xc3296956897c4aef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd7f expref: 8 pid: 6699 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919123.878749:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 58 00000100:00100000:2.0:1790919123.878759:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+8:2353:x1877914532505600:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790919123.878775:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919123.878799:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c97af259/0xc3296956897c4aef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd7f expref: 8 pid: 6699 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.878811:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c97af259/0xc3296956897c4aef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd7f expref: 8 pid: 6699 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.878833:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c97af259/0xc3296956897c4aef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd7f expref: 8 pid: 6699 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.878852:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790919123.878857:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790919123.878862:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000057551289/0xc3296956897c4b12 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.878872:0:5830:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057551289/0xc3296956897c4b12 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.878905:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919123.878967:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:2353:x1877914532505600:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 209us (1521us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919123.878974:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 58 00010000:00010000:0.0:1790919123.879514:0:6700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000057551289/0xc3296956897c4b12 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.879582:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057551289/0xc3296956897c4b12 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.879612:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000057551289/0xc3296956897c4b12 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.879620:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057551289/0xc3296956897c4b12 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.879628:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057551289/0xc3296956897c4b12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.879650:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac59600 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:0.0:1790919123.879655:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057551289/0xc3296956897c4b12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.879663:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057551289/0xc3296956897c4b12 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.879678:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057551289/0xc3296956897c4b12 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.879686:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057551289/0xc3296956897c4b12 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919123.879754:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba027800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2352:x1877914532505472:12345-192.168.201.27@tcp:1:lhsmtool_posix.0 Request processed in 9795us (10160us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919123.879762:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 44 00000100:00100000:0.0:1790919123.884116:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919123.884190:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532505856 00000100:00100000:2.0:1790919123.884201:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532505856 00000100:00100000:2.0:1790919123.884257:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 127 00000100:00100000:2.0:1790919123.884274:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+14:10527:x1877914532505856:12345-192.168.201.27@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1790919123.884356:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4b19 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.884373:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4b19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.884393:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4b19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.884639:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4b20 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.884650:0:8231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c4ad3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd6a expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.884658:0:8231:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4b20 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.884695:0:8231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c4ad3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd6a expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.884711:0:8231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c4ad3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd6a expref: 15 pid: 5846 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919123.884724:0:8231:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb0b1f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8231:1877914550342144:192.168.201.27@tcp:104: 00000100:00100000:2.0:1790919123.884800:0:8231:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be838f8240 going to sleep for 11 seconds 00000100:00100000:2.0:1790919123.889091:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919123.889219:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532505984 00000100:00100000:1.0:1790919123.889228:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532505984 00010000:00010000:1.0:1790919123.889290:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c4ad3 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd6a expref: 16 pid: 5846 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919123.889338:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 59 00000100:00100000:1.0:1790919123.889349:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+16:2353:x1877914532505984:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790919123.889364:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919123.889371:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c4ad3 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd6a expref: 16 pid: 5846 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.889395:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c4ad3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd6a expref: 16 pid: 5846 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.889419:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88be85efc000) 00010000:00010000:1.0:1790919123.889425:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4b20 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.889435:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4b20 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.889442:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4b20 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.889460:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919123.889520:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+16:2353:x1877914532505984:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 173us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919123.889554:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 59 00010000:00010000:0.0:1790919123.891167:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c4ad3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd6a expref: 15 pid: 5846 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919123.891191:0:8231:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb0b1f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8231:1877914550342144:192.168.201.27@tcp:104: 00010000:00010000:0.0:1790919123.891216:0:8231:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4b20 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.891371:0:8231:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4b20 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919123.891445:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4b20 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790919123.891692:0:8231:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:1.0:1790919123.891837:0:8231:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1790919123.891885:0:8231:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1790919123.891974:0:8231:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beba027480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8231:1877914550342272:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1790919123.892228:0:8231:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919123.892327:0:8231:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be92487c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790919123.892512:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550342272 00000100:00100000:0.0:1790919123.893223:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550342272 00000100:00100000:0.0:1790919123.893355:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790919123.893365:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8231:x1877914550342272:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1790919123.893482:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8231:x1877914550342272:12345-0@lo:1000:mdt00_003.0 Request processed in 119us (1254us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919123.893490:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790919123.893758:0:8231:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:3.0:1790919123.893765:0:8231:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:3.0:1790919123.893785:0:8231:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88beb3b39180, transno 4294967309 00000100:00100000:3.0:1790919123.893806:0:8231:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beba027480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8231:1877914550342272:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1790919123.894328:0:8231:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1790919123.894412:0:8231:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb4266300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8231:1877914550342400:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1790919123.894466:0:8231:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919123.895320:0:8231:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bebfbc9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790919123.895476:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550342400 00000100:00100000:2.0:1790919123.895485:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550342400 00000100:00100000:2.0:1790919123.895554:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790919123.895564:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8231:x1877914550342400:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1790919123.895829:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8231:x1877914550342400:12345-0@lo:1000:mdt00_003.0 Request processed in 266us (1361us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1790919123.895838:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790919123.896756:0:8231:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb4266300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8231:1877914550342400:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1790919123.896801:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4b20 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.896811:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4b20 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.896819:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4b20 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.896825:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386600 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919123.896830:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4b20 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.896838:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4b20 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.896854:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88be85efc000) 00010000:00010000:3.0:1790919123.896857:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790919123.896862:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4b20 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.896867:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4b20 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.896900:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4a63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.896907:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4a63 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.896927:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4a63 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.896932:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88387400 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919123.896935:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4a63 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.896942:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4a63 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.896950:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88be853b5400) 00010000:00010000:3.0:1790919123.896953:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790919123.896960:0:8231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4a6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd4e expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.896971:0:8231:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4a6a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd4e expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.896980:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4a6a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd4e expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.897186:0:8231:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4a6a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd4e expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919123.897202:0:8231:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb4266d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8231:1877914550342528:192.168.201.27@tcp:105: 00000100:00100000:3.0:1790919123.897489:0:8231:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bebfbc9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790919123.902593:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919123.902695:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532506112 00000100:00100000:1.0:1790919123.902704:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532506112 00000100:00100000:1.0:1790919123.902753:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 31 00000100:00100000:1.0:1790919123.902763:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+19:10526:x1877914532506112:12345-192.168.201.27@tcp:49:lfs.0 00000100:00100000:1.0:1790919123.902913:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+19:10526:x1877914532506112:12345-192.168.201.27@tcp:49:lfs.0 Request processed in 150us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919123.902921:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 31 00000100:00100000:3.0:1790919123.903466:0:8231:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb4266d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8231:1877914550342528:192.168.201.27@tcp:105: 00010000:00010000:3.0:1790919123.903508:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4a63 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.903519:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4a63 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.903572:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4b27 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.903585:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4b27 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.903596:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4b27 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.903606:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4b27 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.903612:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4b27 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.903618:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4b27 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.903624:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81672c00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919123.903628:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4b27 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.903634:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4b27 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.903644:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88be853b5400) 00010000:00010000:3.0:1790919123.903647:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919123.903656:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4b27 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.903662:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4b27 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.903671:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4b19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.903677:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4b19 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.903684:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4b19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.903688:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386c00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919123.903691:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4b19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.903696:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4b19 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.903703:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88be853b5400) 00010000:00010000:3.0:1790919123.903705:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790919123.903707:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4b19 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.903712:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4b19 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919123.903881:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+18:10527:x1877914532505856:12345-192.168.201.27@tcp:57:lhsmtool_posix.0 Request processed in 19607us (19773us total) trans 4294967406 rc 0/0 00000100:00100000:3.0:1790919123.903889:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 127 00000020:00080000:3.0:1790919123.903898:0:8231:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1790919123.904115:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790919123.904121:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790919123.904714:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1790919123.904721:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790919123.907854:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919123.907945:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532506368 00000100:00100000:3.0:1790919123.907956:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532506368 00000100:00100000:3.0:1790919123.908021:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 128 00000100:00100000:3.0:1790919123.908031:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+18:10526:x1877914532506368:12345-192.168.201.27@tcp:58:lfs.0 00000040:00080000:3.0:1790919123.908451:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1790919123.908568:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+18:10526:x1877914532506368:12345-192.168.201.27@tcp:58:lfs.0 Request processed in 537us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919123.908577:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 128 00000100:00100000:1.0:1790919123.914131:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919123.914235:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532506624 00000100:00100000:2.0:1790919123.914245:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532506624 00000100:00100000:2.0:1790919123.914339:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 32 00000100:00100000:2.0:1790919123.914350:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be92909050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+18:10527:x1877914532506624:12345-192.168.201.27@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1790919123.915022:0:5849:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1790919123.915130:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1790919123.915176:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c4b2e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.915194:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c4b2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.915205:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c4b2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.915226:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c4b2e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.915234:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c4b2e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.915240:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c4b2e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.915269:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790919123.915360:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be92909050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+20:10527:x1877914532506624:12345-192.168.201.27@tcp:35:lhsmtool_posix.0 Request processed in 1011us (1239us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1790919123.915369:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 32 00000020:00080000:2.0:1790919123.915374:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790919123.915727:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790919123.915734:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c4b2e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.915742:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88387a00 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:3.0:1790919123.915746:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c4b2e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.915754:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c4b2e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.915768:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88be85efc800) 00010000:00010000:3.0:1790919123.915771:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790919123.915775:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c4b2e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.915781:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c4b2e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.915799:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919123.915801:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919123.915802:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919123.954381:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919123.954484:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532506752 00000100:00100000:3.0:1790919123.954494:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532506752 00000100:00100000:3.0:1790919123.954592:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 129 00000100:00100000:3.0:1790919123.954602:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+20:10529:x1877914532506752:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:3.0:1790919123.954623:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919123.954644:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4b35 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cd86 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.954702:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4b3c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.954714:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4b3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.954724:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4b3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.954737:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4b43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.954744:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4b43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.954750:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4b43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.954960:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673600/0xc3296956897c4b4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.954970:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4a55 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd47 expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.954988:0:5845:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673600/0xc3296956897c4b4a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.955017:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4a55 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd47 expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919123.955030:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4a55 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd47 expref: 21 pid: 5846 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919123.955043:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb4266d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1877914550342656:192.168.201.27@tcp:104: 00000100:00100000:3.0:1790919123.955120:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bebfbc90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790919123.963765:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919123.963946:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532507008 00000100:00100000:2.0:1790919123.963954:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532507008 00000100:00100000:3.0:1790919123.963962:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb4266d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1877914550342656:192.168.201.27@tcp:104: 00010000:00010000:3.0:1790919123.963987:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673600/0xc3296956897c4b4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919123.964011:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 33 00000100:00100000:2.0:1790919123.964021:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+22:5589:x1877914532507008:12345-192.168.201.27@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1790919123.964285:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+23:5589:x1877914532507008:12345-192.168.201.27@tcp:35:ldlm_bl.0 Request processed in 264us (529us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1790919123.964293:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 33 00000100:00100000:2.0:1790919123.966911:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919123.967293:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532507136 00000100:00100000:0.0:1790919123.967314:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532507136 00010000:00010000:0.0:1790919123.967356:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4a55 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd47 expref: 23 pid: 5846 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919123.967398:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 60 00000100:00100000:0.0:1790919123.967409:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be91cac450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+23:2353:x1877914532507136:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790919123.967424:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919123.967430:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4a55 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd47 expref: 23 pid: 5846 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.967443:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4a55 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd47 expref: 23 pid: 5846 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.967464:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4a55 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd47 expref: 23 pid: 5846 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.967481:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88be853b5400) 00010000:00010000:0.0:1790919123.967487:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673600/0xc3296956897c4b4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.967497:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673600/0xc3296956897c4b4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.967519:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673600/0xc3296956897c4b4a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919123.967609:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919123.967657:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be91cac450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+22:2353:x1877914532507136:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 249us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919123.967665:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 60 00010000:00010000:2.0:1790919123.968468:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673600/0xc3296956897c4b4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.968590:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673600/0xc3296956897c4b4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919123.968647:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1790919123.968652:0:5845:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790919123.968672:0:5845:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673600/0xc3296956897c4b4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.968685:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673600/0xc3296956897c4b4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.968694:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4b3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.968700:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4b3c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.968706:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4b3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.968712:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81673800 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919123.968716:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4b3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.968723:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4b3c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.968734:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88be8b621100) 00010000:00010000:2.0:1790919123.968737:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919123.968741:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4b3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.968747:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4b3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.968773:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4b43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.968780:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4b43 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.968785:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4b43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.968790:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81673200 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919123.968793:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4b43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.968798:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4b43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.968806:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88be88e22500) 00010000:00010000:2.0:1790919123.968808:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919123.968811:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4b43 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.968816:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4b43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.968853:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4b35 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd86 expref: 22 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.968868:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673600/0xc3296956897c4b4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd86 expref: 21 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919123.968885:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88be853b5400) 00010000:00010000:2.0:1790919123.968887:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790919123.968890:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81673600, rc 0) 00000100:00100000:2.0:1790919123.969513:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+21:10529:x1877914532506752:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 14911us (15139us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919123.969521:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 129 00010000:00010000:2.0:1790919124.225729:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790919124.719176:0:12125:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790919124.719185:0:12125:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790919124.719230:0:12125:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1790919124.719236:0:12125:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1790919124.928167:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790919124.928177:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790919124.928241:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1790919124.928264:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790919124.928416:0:11708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac3d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11708:1877914550342784:192.168.201.27@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790919124.928563:0:11708:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb3f489c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790919124.936649:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919124.936736:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532507264 00000100:00100000:3.0:1790919124.936745:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532507264 00000100:00100000:3.0:1790919124.936827:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 130 00000100:00100000:3.0:1790919124.936839:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+22:10541:x1877914532507264:12345-192.168.201.27@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790919124.936876:0:5846:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790919124.936976:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+22:10541:x1877914532507264:12345-192.168.201.27@tcp:53:lhsmtool_posix.0 Request processed in 140us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919124.937013:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 130 00000100:00100000:2.0:1790919124.937639:0:11708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac3d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11708:1877914550342784:192.168.201.27@tcp:107:hsm_cdtr.0 00000100:00080000:0.0:1790919124.937890:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790919124.956856:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919124.957066:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532507520 00000100:00100000:3.0:1790919124.957077:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532507520 00000100:00100000:3.0:1790919124.957132:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 131 00000100:00100000:3.0:1790919124.957141:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+21:10541:x1877914532507520:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790919124.957163:0:8231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919124.957183:0:8231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4b51 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cd8d expref: -99 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919124.957288:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4b58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919124.957303:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4b58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919124.957315:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4b58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919124.957326:0:8231:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1790919124.957449:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4b51 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd8d expref: 24 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919124.957468:0:8231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4b58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd8d expref: 23 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919124.957478:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88be853b5400) 00010000:00010000:3.0:1790919124.957481:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790919124.957485:0:8231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81673200, rc 0) 00000100:00100000:3.0:1790919124.957614:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+23:10541:x1877914532507520:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 473us (767us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1790919124.957620:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 131 00000100:00100000:1.0:1790919124.966454:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919124.966512:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919124.966686:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532507776 00000100:00100000:3.0:1790919124.966697:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532507776 00000100:00100000:3.0:1790919124.966757:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 132 00000100:00100000:3.0:1790919124.966767:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba03f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+23:10541:x1877914532507776:12345-192.168.201.27@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1790919124.966848:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4b66 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919124.966865:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4b66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919124.966876:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4b66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919124.967087:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4b66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919124.967096:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4b66 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919124.967103:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4b66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919124.967109:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81672c00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919124.967113:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4b66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919124.967121:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4b66 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919124.967145:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88be853b5400) 00010000:00010000:3.0:1790919124.967148:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790919124.967153:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4b66 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919124.967159:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4b66 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919124.967328:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba03f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+24:10541:x1877914532507776:12345-192.168.201.27@tcp:57:lhsmtool_posix.0 Request processed in 562us (883us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1790919124.967337:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 132 00000040:00080000:2.0:1790919124.967608:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790919124.967613:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790919124.968088:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1790919124.968097:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790919124.972713:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919124.972820:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532508160 00000100:00100000:2.0:1790919124.972831:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532508160 00000100:00100000:2.0:1790919124.972892:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 34 00000100:00100000:2.0:1790919124.972901:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba03c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+24:10541:x1877914532508160:12345-192.168.201.27@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790919124.973148:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba03c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+25:10541:x1877914532508160:12345-192.168.201.27@tcp:35:lhsmtool_posix.0 Request processed in 247us (443us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1790919124.973172:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 34 00000100:00100000:0.0:1790919124.974899:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532507904 00000100:00100000:0.0:1790919124.974911:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532507904 00000100:00100000:0.0:1790919124.974978:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 9 00000100:00100000:0.0:1790919124.974995:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba03e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+25:2353:x1877914532507904:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790919124.975011:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919124.975035:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4b58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd8d expref: 25 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919124.975067:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88be853b5400) 00010000:00010000:0.0:1790919124.975073:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919124.975118:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba03e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+24:2353:x1877914532507904:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 133us (8605us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919124.975125:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 9 00010000:00010000:3.0:1790919125.247872:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919125.248155:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf752680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550343296:0@lo:400:kworker.0 00000100:00100000:3.0:1790919125.248220:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919125.248299:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1790919125.248307:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3307:1877914550342912:0@lo:400:kworker.0 00000100:00100000:3.0:1790919125.248347:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919125.248373:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf750700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1877914550343424:0@lo:400:kworker.0 00000100:00100000:3.0:1790919125.248397:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919125.248428:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550342912 00000100:00100000:3.0:1790919125.248436:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550342912 00000100:00100000:3.0:1790919125.248480:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1790919125.248490:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3307:x1877914550342912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919125.248575:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3307:x1877914550342912:12345-0@lo:400:kworker.0 Request processed in 85us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919125.248582:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1790919125.248640:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3307:1877914550342912:0@lo:400:kworker.0 00000100:00100000:3.0:1790919125.248682:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550343424 00000100:00100000:3.0:1790919125.248685:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550343424 00000100:00100000:3.0:1790919125.248721:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1790919125.248728:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877914550343424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919125.248766:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877914550343424:12345-0@lo:400:kworker.0 Request processed in 38us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919125.248772:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:3.0:1790919125.248791:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790919125.248811:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf750700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1877914550343424:0@lo:400:kworker.0 00000100:00100000:0.0:1790919125.249014:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb413ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1877914550343168:0@lo:400:kworker.0 00000100:00100000:0.0:1790919125.249046:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919125.249075:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1790919125.249081:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebfbf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877914550343040:0@lo:400:kworker.0 00000100:00100000:0.0:1790919125.249102:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919125.249123:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf750000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550343552:0@lo:400:kworker.0 00000100:00100000:0.0:1790919125.249137:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919125.249153:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550343168 00000100:00100000:0.0:1790919125.249156:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550343168 00000100:00100000:0.0:1790919125.249173:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550343040 00000100:00100000:0.0:1790919125.249175:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550343040 00000100:00100000:0.0:1790919125.249183:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1790919125.249187:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877914550343168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919125.249210:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877914550343168:12345-0@lo:400:kworker.0 Request processed in 23us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919125.249214:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1790919125.249221:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1790919125.249225:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877914550343040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919125.249257:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877914550343040:12345-0@lo:400:kworker.0 Request processed in 30us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919125.249262:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1790919125.249287:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebfbf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877914550343040:0@lo:400:kworker.0 00000100:00100000:0.0:1790919125.249296:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb413ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1877914550343168:0@lo:400:kworker.0 00000100:00100000:2.0:1790919125.249462:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550343296 00000100:00100000:2.0:1790919125.249467:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550343296 00000100:00100000:2.0:1790919125.249503:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550343552 00000100:00100000:2.0:1790919125.249506:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550343552 00000100:00100000:2.0:1790919125.249564:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790919125.249570:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1877914550343296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919125.249599:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1877914550343296:12345-0@lo:400:kworker.0 Request processed in 30us (1380us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919125.249603:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790919125.249612:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1790919125.249615:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1877914550343552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919125.249631:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1877914550343552:12345-0@lo:400:kworker.0 Request processed in 16us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919125.249634:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:3.0:1790919125.249931:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790919125.249935:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790919125.249937:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790919125.249955:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf752680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550343296:0@lo:400:kworker.0 00000100:00100000:0.0:1790919125.252174:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf750000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550343552:0@lo:400:kworker.0 00000100:00100000:0.0:1790919125.759942:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beba03c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550343680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790919125.760032:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919125.760352:0:11721:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550343680 00000100:00100000:1.0:1790919125.760362:0:11721:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550343680 00000100:00100000:1.0:1790919125.760416:0:11721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790919125.760426:0:11721:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1877914550343680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790919125.760465:0:11721:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919125.760543:0:11721:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1877914550343680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919125.760564:0:11721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790919125.760671:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beba03c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550343680:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790919126.274931:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790919126.637791:0:12176:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790919126.637800:0:12176:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790919126.637841:0:12176:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1790919126.637848:0:12176:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:3.0:1790919126.856663:0:7662:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:3.0:1790919126.856682:0:7662:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:1.0:1790919126.880204:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919126.881670:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532508416 00000100:00100000:0.0:1790919126.881684:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532508416 00000100:00100000:0.0:1790919126.881802:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 133 00000100:00100000:0.0:1790919126.881813:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba03d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+24:10561:x1877914532508416:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:0.0:1790919126.881858:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919126.881880:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c4b6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cd94 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919126.881980:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59600/0xc3296956897c4b74 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919126.881994:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59600/0xc3296956897c4b74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919126.882005:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59600/0xc3296956897c4b74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919126.882015:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1790919126.882145:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c4b6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd94 expref: 27 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919126.882162:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59600/0xc3296956897c4b74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd94 expref: 26 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919126.882171:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88be853b5400) 00010000:00010000:0.0:1790919126.882173:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1790919126.882177:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac59600, rc 0) 00000100:00100000:0.0:1790919126.882247:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba03d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+26:10561:x1877914532508416:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 436us (2052us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1790919126.882255:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 133 00000100:00080000:3.0:1790919126.887758:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790919126.891780:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919126.891860:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532508544 00000100:00100000:3.0:1790919126.891871:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532508544 00000100:00100000:3.0:1790919126.891926:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 134 00000100:00100000:3.0:1790919126.891935:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba03e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+26:10561:x1877914532508544:12345-192.168.201.27@tcp:54:lfs.0 00010000:00010000:3.0:1790919126.891998:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4b82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919126.892015:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4b82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919126.892033:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4b82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919126.892057:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4b82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919126.892064:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4b82 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919126.892071:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4b82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919126.892077:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81673800 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919126.892081:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4b82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919126.892089:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4b82 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919126.892099:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88be853b5400) 00010000:00010000:3.0:1790919126.892102:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790919126.892106:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4b82 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919126.892113:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4b82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919126.892181:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba03e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+26:10561:x1877914532508544:12345-192.168.201.27@tcp:54:lfs.0 Request processed in 246us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919126.892188:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 134 00000100:00100000:0.0:1790919127.023058:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919127.023622:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532508672 00000100:00100000:2.0:1790919127.023633:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532508672 00000100:00100000:2.0:1790919127.023776:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 45 00000100:00100000:2.0:1790919127.023789:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb413ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2352:x1877914532508672:12345-192.168.201.27@tcp:101:cat.0 00010000:00010000:2.0:1790919127.023808:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919127.023830:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b864d4c7/0xc3296956897c4b89 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cd9b expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790919127.023871:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6abf41d4, atime: 0x6abf41d3, ctime: 0x6abf41d4, blocks: 0xb 00010000:00010000:2.0:1790919127.023891:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=328s v=(0 0) 00010000:00010000:2.0:1790919127.023895:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919127.023919:0:6698:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b864d4c7/0xc3296956897c4b89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd9b expref: 7 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919127.023939:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b864d4c7/0xc3296956897c4b89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd9b expref: 7 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919127.023963:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be88387a00, rc 0) 00000100:00100000:2.0:1790919127.024023:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb413ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:2352:x1877914532508672:12345-192.168.201.27@tcp:101:cat.0 Request processed in 237us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919127.024030:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 45 00000100:00080000:3.0:1790919127.029847:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790919127.030766:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919127.030845:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532508800 00000100:00100000:0.0:1790919127.030856:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532508800 00002000:00100000:0.0:1790919127.030917:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff88beba03f100 x1877914532508800/t0(0) o3->c4a4e085-55d7-40e9-993c-11b4dfc2d5f5@192.168.201.27@tcp:248/0 lens 488/0 e 0 to 0 dl 1790919138 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790919127.030928:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88beba03f100 with x1877914532508800 ext(0->4095) 00002000:00010000:0.0:1790919127.030933:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88beba03f100 00000100:00100000:0.0:1790919127.030972:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 3 00000100:00100000:0.0:1790919127.030981:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba03f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:2350:x1877914532508800:12345-192.168.201.27@tcp:3:cat.0 00000100:00100000:0.0:1790919127.031225:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba03f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:2350:x1877914532508800:12345-192.168.201.27@tcp:3:cat.0 Request processed in 244us (465us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1790919127.031233:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 3 00002000:00100000:0.0:1790919127.031239:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff88beba03f100 x1877914532508800/t0(0) o3->c4a4e085-55d7-40e9-993c-11b4dfc2d5f5@192.168.201.27@tcp:248/0 lens 488/4536 e 0 to 0 dl 1790919138 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790919127.031247:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88beba03f100 with x1877914532508800 ext(0->4095) 00002000:00010000:0.0:1790919127.031250:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88beba03f100 00010000:00010000:2.0:1790919127.295750:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1790919127.809760:0:7163:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 329698230890ns, next at 330698228456ns, rc = 0 00000100:00100000:2.0:1790919127.809794:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790919127.809812:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf751180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550343808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790919127.809877:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919127.809953:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550343808 00000100:00100000:2.0:1790919127.809960:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550343808 00000100:00100000:2.0:1790919127.810014:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790919127.810023:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf752300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1877914550343808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790919127.810064:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790919127.810109:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf752300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1877914550343808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919127.810117:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1790919127.810139:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790919127.810168:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf751180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550343808:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790919128.320732:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919128.782509:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919128.782604:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919128.782638:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919128.782661:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919128.782687:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919128.782717:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532509056 00000100:00100000:3.0:1790919128.782726:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532509056 00000100:00100000:3.0:1790919128.782788:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532509440 00000100:00100000:3.0:1790919128.782792:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532509440 00000100:00100000:3.0:1790919128.782816:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 141 00000100:00100000:3.0:1790919128.782825:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+26:2350:x1877914532509056:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1790919128.782897:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+26:2350:x1877914532509056:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 72us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919128.782905:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 141 00000100:00100000:3.0:1790919128.782922:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 142 00000100:00100000:3.0:1790919128.782929:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5591729f-44f1-43f1-b042-c3a508737d97+5:2350:x1877914532509440:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1790919128.782955:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5591729f-44f1-43f1-b042-c3a508737d97+5:2350:x1877914532509440:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 26us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919128.782962:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 142 00000100:00100000:3.0:1790919128.782980:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532509312 00000100:00100000:3.0:1790919128.782984:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532509312 00000100:00100000:3.0:1790919128.783010:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532509184 00000100:00100000:3.0:1790919128.783013:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532509184 00000100:00100000:3.0:1790919128.783031:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 80 00000100:00100000:3.0:1790919128.783037:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2350:x1877914532509312:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1790919128.783063:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2350:x1877914532509312:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 27us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919128.783083:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 80 00000100:00100000:3.0:1790919128.783095:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 81 00000100:00100000:3.0:1790919128.783101:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:2350:x1877914532509184:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1790919128.783127:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:2350:x1877914532509184:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 26us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919128.783133:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 81 00000100:00100000:3.0:1790919128.783151:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532508928 00000100:00100000:3.0:1790919128.783155:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532508928 00000100:00100000:3.0:1790919128.783192:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 291 00000100:00100000:3.0:1790919128.783199:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be870ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+13:2350:x1877914532508928:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1790919128.783224:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be870ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+13:2350:x1877914532508928:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 26us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919128.783231:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 291 00000100:00080000:3.0:1790919128.783263:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790919128.783268:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1790919128.893458:0:5869:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1790919128.893477:0:5869:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000004:00080000:0.0:1790919128.893499:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1790919128.893565:0:5869:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88bebfbc9d80 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1790919128.893571:0:5869:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88be9261da00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88bebfbc9e40 00000020:00080000:0.0:1790919128.893574:0:5869:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88be9261db00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88beba117800 00000020:00080000:0.0:1790919128.893656:0:5880:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1790919128.893845:0:5880:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:2.0:1790919128.894563:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beba03fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550343936:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1790919128.894651:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919128.895201:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550343936 00000100:00100000:1.0:1790919128.895209:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550343936 00000100:00100000:1.0:1790919128.895260:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790919128.895269:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf751180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1877914550343936:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1790919128.895470:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1790919128.895474:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1790919124 -> 1790919124 00002000:00010000:1.0:1790919128.895476:0:6699:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 1790919123 -> 1790919123 00002000:00010000:1.0:1790919128.895478:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1790919124 -> 1790919124 00002000:00010000:1.0:1790919128.895480:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1790919128.895545:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf751180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1877914550343936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 258us (874us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1790919128.895554:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000004:00080000:1.0:1790919128.895596:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88beba03fb80/2, rc 0, transno 4294967312 00000100:00100000:1.0:1790919128.895602:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beba03fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550343936:0@lo:2:osp-syn-0-0.0 00000001:00080000:1.0:1790919128.915752:0:6722:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:1.0:1790919128.915767:0:6722:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000040:00080000:2.0:1790919129.088924:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790919129.088932:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790919129.088957:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1790919129.088961:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1790919129.343827:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919130.368019:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1877914550344320:0@lo:400:kworker.0 00000100:00100000:3.0:1790919130.368112:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877914550344192:0@lo:400:kworker.0 00000100:00100000:0.0:1790919130.368112:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790919130.368244:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919130.368366:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550344320 00000100:00100000:1.0:1790919130.368388:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550344320 00000100:00100000:1.0:1790919130.368438:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1790919130.368447:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebfbf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877914550344320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919130.368551:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790919130.368559:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550344448:0@lo:400:kworker.0 00000100:00100000:2.0:1790919130.368622:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550344064:0@lo:400:kworker.0 00000100:00100000:3.0:1790919130.374187:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919130.376205:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be83438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550344704:0@lo:400:kworker.0 00000100:00100000:1.0:1790919130.376421:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebfbf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877914550344320:12345-0@lo:400:kworker.0 Request processed in 7973us (8307us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919130.376432:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1790919130.376460:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550344192 00000100:00100000:1.0:1790919130.376467:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550344192 00000100:00100000:1.0:1790919130.376509:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1790919130.376516:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf789c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877914550344192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919130.376582:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf789c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877914550344192:12345-0@lo:400:kworker.0 Request processed in 67us (2405us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919130.376588:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:1.0:1790919130.376644:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790919130.376760:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919130.376787:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be83439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1877914550344576:0@lo:400:kworker.0 00000100:00100000:2.0:1790919130.376812:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919130.376839:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550344576 00000100:00100000:2.0:1790919130.376842:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550344576 00000100:00100000:2.0:1790919130.376869:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1790919130.376875:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf753100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877914550344576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919130.376904:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf753100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877914550344576:12345-0@lo:400:kworker.0 Request processed in 29us (91us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919130.376909:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:2.0:1790919130.376928:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790919130.376952:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be83439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1877914550344576:0@lo:400:kworker.0 00000100:00100000:1.0:1790919130.378905:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550344064 00000100:00100000:1.0:1790919130.378920:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550344064 00000100:00100000:1.0:1790919130.378987:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1790919130.379347:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87167450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3305:x1877914550344064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919130.379435:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87167450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3305:x1877914550344064:12345-0@lo:400:kworker.0 Request processed in 94us (2674us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919130.379442:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1790919130.379575:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550344064:0@lo:400:kworker.0 00000100:00100000:0.0:1790919130.382688:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919130.382780:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1877914550344320:0@lo:400:kworker.0 00000100:00100000:2.0:1790919130.383312:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550344448 00000100:00100000:2.0:1790919130.383321:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550344448 00000100:00100000:2.0:1790919130.383395:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790919130.383406:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1877914550344448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919130.383476:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1877914550344448:12345-0@lo:400:kworker.0 Request processed in 73us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919130.383484:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1790919130.383591:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790919130.384258:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:0.0:1790919130.384266:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967311 00000100:00100000:0.0:1790919130.384287:0:3307:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff88beba03fb80 x1877914550343936/t4294967312(4294967312) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1790919144 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919130.384299:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550344448:0@lo:400:kworker.0 00000100:00100000:3.0:1790919130.387082:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919130.387167:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877914550344192:0@lo:400:kworker.0 00000100:00100000:1.0:1790919130.389494:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550344704 00000100:00100000:1.0:1790919130.389510:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550344704 00000100:00080000:2.0:1790919130.389570:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790919130.389598:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1790919130.389686:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf78b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550344704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919130.389774:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf78b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550344704:12345-0@lo:400:kworker.0 Request processed in 168us (2701us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919130.389865:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1790919130.389871:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:3.0:1790919130.389893:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88beb40e0e00, transno 4294967304 00000100:00100000:3.0:1790919130.389927:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be83438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550344704:0@lo:400:kworker.0 00000100:00100000:1.0:1790919130.392225:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1790919130.887641:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beba03c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550344832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790919130.887712:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919130.887787:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550344832 00000100:00100000:1.0:1790919130.887795:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550344832 00000100:00100000:1.0:1790919130.887840:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790919130.887849:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba03ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550344832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790919130.887897:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919130.887943:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba03ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550344832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919130.887950:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790919130.887997:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beba03c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550344832:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790919131.391811:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919131.951732:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919131.953228:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532509568 00000100:00100000:1.0:1790919131.953246:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532509568 00000100:00100000:1.0:1790919131.953492:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 135 00000100:00100000:1.0:1790919131.953505:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf789500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+13:10206:x1877914532509568:12345-192.168.201.27@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1790919131.953654:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf789500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+13:10206:x1877914532509568:12345-192.168.201.27@tcp:60:lhsmtool_posix.0 Request processed in 152us (1933us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919131.953663:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 135 00000100:00080000:2.0:1790919131.954828:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790919131.958370:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919131.958570:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532509824 00000100:00100000:1.0:1790919131.958581:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532509824 00000100:00100000:1.0:1790919131.958643:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 35 00000100:00100000:1.0:1790919131.958654:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf789880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+13:10206:x1877914532509824:12345-192.168.201.27@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790919131.959189:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf789880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+14:10206:x1877914532509824:12345-192.168.201.27@tcp:35:lhsmtool_posix.0 Request processed in 534us (829us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1790919131.959212:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 35 00010000:00010000:3.0:1790919132.415767:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919132.927904:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790919132.927929:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf753b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550344960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790919132.928015:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919132.928271:0:11721:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550344960 00000100:00100000:0.0:1790919132.928280:0:11721:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550344960 00000100:00100000:0.0:1790919132.928361:0:11721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790919132.928371:0:11721:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf78aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1877914550344960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790919132.928407:0:11721:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790919132.928465:0:11721:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf78aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1877914550344960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919132.928472:0:11721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:2.0:1790919132.928551:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790919132.929139:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf753b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550344960:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790919133.440780:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919133.909167:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919133.909229:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919133.909267:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919133.909389:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532509952 00000100:00100000:1.0:1790919133.909400:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532509952 00000100:00100000:1.0:1790919133.909460:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 293 00000100:00100000:1.0:1790919133.909472:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+13:2350:x1877914532509952:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:1.0:1790919133.909583:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+13:2350:x1877914532509952:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 112us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919133.909591:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 293 00000100:00100000:2.0:1790919133.910131:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532510208 00000100:00100000:2.0:1790919133.910138:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532510208 00000100:00100000:2.0:1790919133.910193:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 84 00000100:00100000:2.0:1790919133.910213:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2350:x1877914532510208:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:2.0:1790919133.910263:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2350:x1877914532510208:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 61us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919133.910270:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 84 00000100:00100000:2.0:1790919133.910293:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532510464 00000100:00100000:2.0:1790919133.910297:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532510464 00000100:00100000:2.0:1790919133.910335:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 146 00000100:00100000:2.0:1790919133.910342:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5591729f-44f1-43f1-b042-c3a508737d97+5:2350:x1877914532510464:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:2.0:1790919133.910377:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5591729f-44f1-43f1-b042-c3a508737d97+5:2350:x1877914532510464:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 35us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919133.910384:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 146 00000100:00080000:1.0:1790919133.910938:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790919133.910944:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790919133.915463:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919133.915507:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919133.918215:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532510080 00000100:00100000:3.0:1790919133.918232:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532510080 00000100:00100000:3.0:1790919133.918316:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 147 00000100:00100000:3.0:1790919133.918327:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+14:2351:x1877914532510080:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1790919133.918481:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+14:2351:x1877914532510080:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 155us (3030us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919133.918489:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 147 00000100:00080000:3.0:1790919133.918518:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790919133.918785:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532510336 00000100:00100000:2.0:1790919133.918791:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532510336 00000100:00100000:2.0:1790919133.918853:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 85 00000100:00100000:2.0:1790919133.918863:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb40e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2351:x1877914532510336:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:2.0:1790919133.918907:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb40e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2351:x1877914532510336:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 46us (3399us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919133.918915:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 85 00000100:00080000:0.0:1790919133.919294:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1790919134.049111:0:6722:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000020:00080000:0.0:1790919134.051699:0:5869:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:0.0:1790919134.051729:0:5869:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1790919134.051778:0:5880:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1790919134.051788:0:5880:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:02000400:2.0:1790919134.060574:0:12379:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 01:32:13 (1790919133) 00010000:00010000:1.0:1790919134.463901:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919135.487840:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919135.488080:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf752a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877914550345216:0@lo:400:kworker.0 00000100:00100000:3.0:1790919135.488155:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919135.488219:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf752d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550345728:0@lo:400:kworker.0 00000100:00100000:3.0:1790919135.488246:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919135.488279:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1790919135.488285:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf750380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3306:1877914550345088:0@lo:400:kworker.0 00000100:00100000:3.0:1790919135.488313:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919135.488335:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf751880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1877914550345600:0@lo:400:kworker.0 00000100:00100000:3.0:1790919135.488391:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919135.488425:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550345728 00000100:00100000:3.0:1790919135.488433:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550345728 00000100:00100000:3.0:1790919135.488484:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1790919135.488494:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550345728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919135.488581:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550345728:12345-0@lo:400:kworker.0 Request processed in 88us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919135.488588:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1790919135.488611:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550345088 00000100:00100000:3.0:1790919135.488615:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550345088 00000100:00100000:3.0:1790919135.488638:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1790919135.488645:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87165c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3306:x1877914550345088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919135.488673:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87165c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3306:x1877914550345088:12345-0@lo:400:kworker.0 Request processed in 29us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919135.488679:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1790919135.488701:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550345216 00000100:00100000:3.0:1790919135.488704:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550345216 00000100:00100000:3.0:1790919135.488723:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550345600 00000100:00100000:3.0:1790919135.488726:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550345600 00000100:00100000:3.0:1790919135.488740:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1790919135.488745:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877914550345216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919135.488771:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877914550345216:12345-0@lo:400:kworker.0 Request processed in 26us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919135.488776:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1790919135.488785:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1790919135.488790:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877914550345600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919135.488813:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877914550345600:12345-0@lo:400:kworker.0 Request processed in 23us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919135.488826:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1790919135.488872:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf750380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3306:1877914550345088:0@lo:400:kworker.0 00000100:00100000:3.0:1790919135.488884:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf751880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1877914550345600:0@lo:400:kworker.0 00000100:00100000:3.0:1790919135.488892:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf752a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877914550345216:0@lo:400:kworker.0 00000100:00100000:3.0:1790919135.488900:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf752d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550345728:0@lo:400:kworker.0 00000100:00080000:0.0:1790919135.489000:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790919135.489006:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790919135.489083:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf751c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1877914550345344:0@lo:400:kworker.0 00000100:00100000:1.0:1790919135.489113:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919135.489142:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790919135.489148:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf750e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550345472:0@lo:400:kworker.0 00000100:00100000:1.0:1790919135.489170:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919135.489250:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550345472 00000100:00100000:0.0:1790919135.489260:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550345472 00000100:00100000:0.0:1790919135.489304:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790919135.489311:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba03dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550345472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919135.489349:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba03dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550345472:12345-0@lo:400:kworker.0 Request processed in 39us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919135.489354:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790919135.489383:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1790919135.489388:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88beba03fb80, transno 4294967312 00000100:00100000:0.0:1790919135.489398:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf750e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550345472:0@lo:400:kworker.0 00000100:00100000:2.0:1790919135.489852:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550345344 00000100:00100000:2.0:1790919135.489863:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550345344 00000100:00100000:2.0:1790919135.489904:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1790919135.489912:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba03c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877914550345344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919135.489958:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba03c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877914550345344:12345-0@lo:400:kworker.0 Request processed in 47us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919135.489964:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:1.0:1790919135.490030:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790919135.490034:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790919135.490155:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf751c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1877914550345344:0@lo:400:kworker.0 00000100:00100000:0.0:1790919135.694229:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919135.697714:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532510720 00000100:00100000:3.0:1790919135.697733:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532510720 00000100:00100000:3.0:1790919135.697832:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 136 00000100:00100000:3.0:1790919135.697843:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb40e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+13:11272:x1877914532510720:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790919135.697865:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919135.697887:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4b90 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cda2 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919135.697961:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4b97 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919135.697975:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4b97 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919135.697985:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4b97 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919135.698001:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4b9e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919135.698008:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4b9e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919135.698033:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4b9e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919135.698335:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c4ba5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919135.698346:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c4ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919135.698354:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c4ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919135.698365:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00000100:00080000:1.0:1790919135.698620:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790919135.698768:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4b97 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919135.698777:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4b97 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919135.698784:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4b97 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919135.698791:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81673800 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919135.698796:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4b97 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919135.698805:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4b97 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919135.698820:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88be8b621700) 00010000:00010000:3.0:1790919135.698824:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919135.698837:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4b97 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919135.698843:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4b97 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919135.698857:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4b9e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919135.698863:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4b9e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919135.698870:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4b9e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919135.698875:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81673200 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919135.698878:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4b9e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919135.698884:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4b9e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919135.698892:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff88be88e22100) 00010000:00010000:3.0:1790919135.698894:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919135.698897:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4b9e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919135.698903:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4b9e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919135.699451:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4b90 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cda2 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919135.700342:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c4ba5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cda2 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919135.700354:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88be85efcb00) 00010000:00010000:3.0:1790919135.700357:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919135.700360:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81516600, rc 0) 00000100:00100000:3.0:1790919135.700488:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb40e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+15:11272:x1877914532510720:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 2646us (6267us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1790919135.700498:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 136 00000100:00100000:2.0:1790919135.713784:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919135.713828:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919135.713848:0:8529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532510848 00000100:00100000:3.0:1790919135.713859:0:8529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532510848 00000100:00100000:0.0:1790919135.713919:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532510976 00000100:00100000:0.0:1790919135.713926:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532510976 00000100:00100000:3.0:1790919135.713933:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 10 00000100:00100000:3.0:1790919135.713945:0:8529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf750a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+16:2351:x1877914532510848:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919135.713960:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790919135.713971:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 137 00000100:00100000:0.0:1790919135.713983:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf751f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+16:11272:x1877914532510976:12345-192.168.201.27@tcp:59:lhsmtool_posix.0 00010000:00010000:3.0:1790919135.713985:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c4ba5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cda2 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919135.714005:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88be85efcb00) 00010000:00010000:3.0:1790919135.714011:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919135.714142:0:8529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf750a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+15:2351:x1877914532510848:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 199us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919135.714150:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 10 00000100:00100000:0.0:1790919135.717489:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf751f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+14:11272:x1877914532510976:12345-192.168.201.27@tcp:59:lhsmtool_posix.0 Request processed in 3496us (3648us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919135.717504:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 137 00000100:00100000:3.0:1790919136.003010:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be85f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550345856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790919136.003093:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919136.003227:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550345856 00000100:00100000:0.0:1790919136.003237:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550345856 00000100:00100000:0.0:1790919136.003293:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790919136.003303:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550345856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790919136.003341:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790919136.003390:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550345856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919136.003397:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790919136.003574:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be85f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550345856:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1790919136.256182:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790919136.256193:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790919136.256935:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1790919136.256946:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1790919136.512244:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919137.536219:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919138.049079:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790919138.049104:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf753480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550345984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790919138.049171:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919138.049229:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550345984 00000100:00100000:3.0:1790919138.049237:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550345984 00000100:00100000:3.0:1790919138.049288:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790919138.049297:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550345984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790919138.049333:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919138.049377:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550345984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919138.049385:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1790919138.049405:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790919138.049435:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf753480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550345984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790919138.141164:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919138.141204:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532511104 00000100:00100000:1.0:1790919138.141214:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532511104 00000100:00100000:1.0:1790919138.141283:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 138 00000100:00100000:1.0:1790919138.141300:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba03ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+14:11314:x1877914532511104:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:1.0:1790919138.141323:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919138.141344:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7fe00/0xc3296956897c4bb3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cda9 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919138.141403:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ea00/0xc3296956897c4bba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919138.141418:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ea00/0xc3296956897c4bba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919138.141430:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ea00/0xc3296956897c4bba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919138.141443:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c4bc1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919138.141450:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c4bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919138.141457:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c4bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919138.141706:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ea00/0xc3296956897c4bba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919138.141715:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ea00/0xc3296956897c4bba lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919138.141722:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ea00/0xc3296956897c4bba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919138.141737:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88beb3f7ea00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:1.0:1790919138.141741:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ea00/0xc3296956897c4bba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919138.141748:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ea00/0xc3296956897c4bba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919138.141760:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be88e22e00) 00010000:00010000:1.0:1790919138.141763:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919138.141768:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ea00/0xc3296956897c4bba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919138.141774:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ea00/0xc3296956897c4bba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919138.141788:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c4bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919138.141793:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c4bc1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919138.141800:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c4bc1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919138.141805:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88beb3f7e600 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:1.0:1790919138.141808:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c4bc1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919138.141813:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c4bc1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919138.141831:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff88be8b621200) 00010000:00010000:1.0:1790919138.141834:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919138.141837:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c4bc1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919138.141843:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c4bc1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919138.141876:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7fe00/0xc3296956897c4bb3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cda9 expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919138.141886:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be88e22e00) 00010000:00010000:1.0:1790919138.141888:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919138.141891:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7fe00/0xc3296956897c4bb3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cda9 expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919138.141902:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88beb3f7fe00, rc 0) 00000100:00100000:1.0:1790919138.141961:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba03ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+14:11314:x1877914532511104:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 663us (806us total) trans 0 rc 301/301 00000100:00100000:1.0:1790919138.141969:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 138 00000100:00080000:1.0:1790919138.141993:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790919138.148504:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919138.149868:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532511360 00000100:00100000:2.0:1790919138.149881:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532511360 00000100:00100000:2.0:1790919138.149950:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 139 00000100:00100000:2.0:1790919138.149961:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba03d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+14:11314:x1877914532511360:12345-192.168.201.27@tcp:36:lfs.0 00010000:00010000:2.0:1790919138.150029:0:8231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919138.150055:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c453f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cbe9 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.150077:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be88e22e00) 00010000:00010000:2.0:1790919138.150089:0:8231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790919138.150301:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4bc8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.150315:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4bc8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.150324:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4bc8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.150336:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4bcf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.150353:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4bcf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.150359:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4bcf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919138.152477:0:8231:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1790919138.152499:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4bc8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.152509:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4bc8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.152516:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4bc8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.152521:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386c00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919138.152601:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4bc8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.152610:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4bc8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.152625:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be85efc000) 00010000:00010000:2.0:1790919138.152629:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919138.152633:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4bc8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.152639:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4bc8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790919138.152668:0:8231:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f2a25b7c reply state 000000007b1bf5c3 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4bcf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919138.152676:0:8231:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790919138.152822:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba03d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+15:11314:x1877914532511360:12345-192.168.201.27@tcp:36:lfs.0 Request processed in 2858us (4322us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1790919138.152831:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 139 00010000:00010000:0.0:1790919138.165333:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4bcf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919138.165350:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4bcf lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919138.165358:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4bcf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919138.165364:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386200 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919138.165368:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4bcf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919138.165375:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4bcf lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919138.165391:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff88be85efc800) 00010000:00010000:0.0:1790919138.165394:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919138.165399:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4bcf lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919138.165405:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4bcf lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919138.259453:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919138.259592:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532511488 00000100:00100000:2.0:1790919138.259617:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532511488 00000100:00100000:2.0:1790919138.259710:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 140 00000100:00100000:2.0:1790919138.259720:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba03ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+14:11322:x1877914532511488:12345-192.168.201.27@tcp:101:lctl.0 00010000:00010000:2.0:1790919138.259749:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919138.259774:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4bd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cdb0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.259853:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c4bdd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.259867:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c4bdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.259879:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c4bdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919138.259986:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790919138.259993:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790919138.260026:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c4bdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.260067:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4bd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdb0 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.260085:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c4bdd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdb0 expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.260094:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be85efc000) 00010000:00010000:2.0:1790919138.260096:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790919138.260100:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be88386e00, rc 0) 00000100:00100000:2.0:1790919138.260163:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba03ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+15:11322:x1877914532511488:12345-192.168.201.27@tcp:101:lctl.0 Request processed in 444us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919138.260170:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 140 00000100:00100000:1.0:1790919138.321218:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919138.322218:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532511616 00000100:00100000:2.0:1790919138.322230:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532511616 00000100:00100000:2.0:1790919138.322295:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 141 00000100:00100000:2.0:1790919138.322305:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba03ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+15:11328:x1877914532511616:12345-192.168.201.27@tcp:101:bash.0 00010000:00010000:2.0:1790919138.322325:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919138.322345:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4be4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cdb7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.322406:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c4beb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.322420:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c4beb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.322431:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c4beb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.322457:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4bf2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.322465:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4bf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.322471:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4bf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.322581:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4bf9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.322588:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4bf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.322594:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4bf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919138.322629:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1790919138.322633:0:5846:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790919138.322651:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4bf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.322662:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c4beb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.322670:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c4beb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.322677:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c4beb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.322692:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88387c00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919138.322696:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c4beb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.322703:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c4beb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.322714:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be85efc000) 00010000:00010000:2.0:1790919138.322717:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919138.322722:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c4beb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.322728:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c4beb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.322740:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4bf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.322746:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4bf2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.322752:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4bf2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.322767:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88387200 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919138.322769:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4bf2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.322775:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4bf2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.322800:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff88be85efc600) 00010000:00010000:2.0:1790919138.322802:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919138.322805:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4bf2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.322811:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4bf2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.323137:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4be4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdb7 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.323150:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4bf9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdb7 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.323158:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88be85efcd00) 00010000:00010000:2.0:1790919138.323160:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1790919138.323162:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be88386200, rc 0) 00000100:00100000:2.0:1790919138.323277:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba03ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+16:11328:x1877914532511616:12345-192.168.201.27@tcp:101:bash.0 Request processed in 973us (2070us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919138.323284:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 141 00000100:00100000:1.0:1790919138.330658:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919138.330758:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532511872 00000100:00100000:3.0:1790919138.330769:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532511872 00000100:00100000:3.0:1790919138.330831:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 142 00000100:00100000:3.0:1790919138.330842:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba03df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+16:11328:x1877914532511872:12345-192.168.201.27@tcp:101:bash.0 00010000:00010000:3.0:1790919138.330863:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919138.330885:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4c00 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cdbe expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919138.331046:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4c07 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919138.331061:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4c07 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919138.331072:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4c07 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919138.331086:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4c0e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919138.331093:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4c0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919138.331099:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4c0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790919138.331778:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1790919138.331970:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c4c15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919138.331989:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c4c15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919138.331997:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c4c15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919138.332049:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4c07 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919138.332067:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4c07 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919138.332073:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4c07 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919138.332079:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81672c00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919138.332083:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4c07 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919138.332091:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4c07 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919138.332102:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88be85efcd00) 00010000:00010000:3.0:1790919138.332105:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919138.332110:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4c07 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919138.332116:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4c07 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790919138.332130:0:5845:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005026127e reply state 000000008cb62da7 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4c0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919138.332138:0:5845:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790919138.332170:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4c00 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdbe expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919138.332185:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c4c15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdbe expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919138.332203:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be88e22500) 00010000:00010000:3.0:1790919138.332205:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790919138.332208:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81672400, rc 0) 00000100:00100000:3.0:1790919138.332305:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba03df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+19:11328:x1877914532511872:12345-192.168.201.27@tcp:101:bash.0 Request processed in 1462us (1652us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1790919138.332317:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 142 00010000:00010000:3.0:1790919138.334035:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4c0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919138.334050:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4c0e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919138.334058:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4c0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919138.334064:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81673800 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919138.334068:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4c0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919138.334076:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4c0e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919138.334090:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88be88e22100) 00010000:00010000:3.0:1790919138.334093:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919138.334097:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4c0e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919138.334103:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4c0e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919138.336289:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919138.336520:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532512000 00000100:00100000:3.0:1790919138.336567:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532512000 00000100:00100000:3.0:1790919138.336648:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 47 00000100:00100000:3.0:1790919138.336659:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba03f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2352:x1877914532512000:12345-192.168.201.27@tcp:101:bash.0 00010000:00010000:3.0:1790919138.336676:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919138.336697:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003439f9ed/0xc3296956897c4c23 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cdc5 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790919138.336725:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919138.336745:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=340s v=(0 0) 00010000:00010000:3.0:1790919138.336750:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919138.336772:0:6698:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003439f9ed/0xc3296956897c4c23 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdc5 expref: 6 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919138.336795:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003439f9ed/0xc3296956897c4c23 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdc5 expref: 6 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919138.336808:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81516600, rc 0) 00000100:00100000:3.0:1790919138.336876:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba03f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2352:x1877914532512000:12345-192.168.201.27@tcp:101:bash.0 Request processed in 219us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919138.336883:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 47 00000100:00080000:1.0:1790919138.337280:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790919138.339742:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919138.339892:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532512128 00000100:00100000:0.0:1790919138.339902:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532512128 00000100:00100000:0.0:1790919138.339960:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 48 00000100:00100000:0.0:1790919138.339969:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf751500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:11328:x1877914532512128:12345-192.168.201.27@tcp:101:bash.0 00010000:00010000:0.0:1790919138.339987:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919138.340005:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007beff5c6/0xc3296956897c4c2a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cdcc expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919138.340080:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003439f9ed/0xc3296956897c4c23 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdc5 expref: 7 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919138.340089:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919138.340093:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919138.340098:0:6700:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007beff5c6/0xc3296956897c4c2a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdcc expref: 7 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919138.340131:0:6700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003439f9ed/0xc3296956897c4c23 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdc5 expref: 7 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919138.340145:0:6700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003439f9ed/0xc3296956897c4c23 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdc5 expref: 7 pid: 6698 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919138.340158:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be85f38a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6700:1877914550346112:192.168.201.27@tcp:104: 00000100:00100000:0.0:1790919138.340242:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be90e4af00 going to sleep for 11 seconds 00000100:00100000:0.0:1790919138.342601:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be85f38a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6700:1877914550346112:192.168.201.27@tcp:104: 00010000:00010000:0.0:1790919138.342910:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007beff5c6/0xc3296956897c4c2a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdcc expref: 7 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919138.343068:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac58e00, rc 0) 00000100:00100000:0.0:1790919138.343162:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf751500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:11328:x1877914532512128:12345-192.168.201.27@tcp:101:bash.0 Request processed in 3193us (3428us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919138.343172:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 48 00000100:00100000:2.0:1790919138.348280:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919138.348513:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532512256 00000100:00100000:3.0:1790919138.348524:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532512256 00010000:00010000:3.0:1790919138.348597:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003439f9ed/0xc3296956897c4c23 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdc5 expref: 7 pid: 6698 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919138.348655:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 61 00000100:00100000:3.0:1790919138.348664:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf753800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:2352:x1877914532512256:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919138.348680:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919138.348704:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003439f9ed/0xc3296956897c4c23 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdc5 expref: 7 pid: 6698 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919138.348719:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003439f9ed/0xc3296956897c4c23 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdc5 expref: 7 pid: 6698 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919138.348744:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003439f9ed/0xc3296956897c4c23 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdc5 expref: 7 pid: 6698 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919138.348780:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919138.348784:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919138.348793:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007beff5c6/0xc3296956897c4c2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdcc expref: 6 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919138.348803:0:5829:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007beff5c6/0xc3296956897c4c2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdcc expref: 6 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919138.348842:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007beff5c6/0xc3296956897c4c2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdcc expref: 6 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919138.348857:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b17800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5829:1877914550346240:192.168.201.27@tcp:105: 00000100:00100000:3.0:1790919138.348940:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be92487900 going to sleep for 11 seconds 00000100:00100000:3.0:1790919138.356404:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b17800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5829:1877914550346240:192.168.201.27@tcp:105: 00010000:00010000:3.0:1790919138.356436:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919138.356516:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf753800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2352:x1877914532512256:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 7852us (8244us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919138.356998:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 61 00000100:00100000:3.0:1790919138.360281:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919138.360687:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532512512 00000100:00100000:2.0:1790919138.360698:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532512512 00000100:00100000:2.0:1790919138.360774:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 36 00000100:00100000:2.0:1790919138.360785:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+18:11328:x1877914532512512:12345-192.168.201.27@tcp:35:bash.0 00000100:00100000:2.0:1790919138.361306:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+19:11328:x1877914532512512:12345-192.168.201.27@tcp:35:bash.0 Request processed in 522us (1033us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1790919138.361329:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 36 00000100:00100000:2.0:1790919138.448470:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919138.448603:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532512768 00000100:00100000:0.0:1790919138.448616:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532512768 00000100:00100000:0.0:1790919138.448682:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 143 00000100:00100000:0.0:1790919138.448693:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf753480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+19:11338:x1877914532512768:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:0.0:1790919138.448725:0:8231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919138.448747:0:8231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c4c31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cdd3 expref: -99 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919138.448882:0:8231:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1790919138.449033:0:8231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c4c31 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdd3 expref: 21 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919138.449048:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be85efc000) 00010000:00010000:0.0:1790919138.449051:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790919138.449066:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c4c31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdd3 expref: 21 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919138.449081:0:8231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac58000, rc 0) 00000100:00100000:0.0:1790919138.449161:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf753480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+20:11338:x1877914532512768:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 470us (704us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1790919138.449169:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 143 00000100:00100000:3.0:1790919138.453263:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919138.453365:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532513024 00000100:00100000:2.0:1790919138.453374:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532513024 00000100:00100000:2.0:1790919138.453433:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 37 00000100:00100000:2.0:1790919138.453443:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+20:11338:x1877914532513024:12345-192.168.201.27@tcp:35:lfs.0 00000100:00100000:2.0:1790919138.453709:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+21:11338:x1877914532513024:12345-192.168.201.27@tcp:35:lfs.0 Request processed in 267us (456us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1790919138.453716:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 37 00000100:00100000:3.0:1790919138.524814:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919138.525089:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532513152 00000100:00100000:2.0:1790919138.525100:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532513152 00000100:00100000:2.0:1790919138.525178:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 144 00000100:00100000:2.0:1790919138.525189:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+21:11344:x1877914532513152:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:2.0:1790919138.525214:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919138.525243:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4c3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cdda expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.525318:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c4c46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.525332:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c4c46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.525342:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c4c46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919138.525372:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1790919138.525387:0:5845:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790919138.525408:0:5845:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c4c46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.525433:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4c3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdda expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.525452:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c4c46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdda expref: 22 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.525462:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88be85efcd00) 00010000:00010000:2.0:1790919138.525465:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790919138.525468:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be88387c00, rc 0) 00000100:00100000:2.0:1790919138.525576:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+22:11344:x1877914532513152:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 389us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919138.525584:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 144 00000100:00100000:3.0:1790919138.530346:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919138.530437:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532513408 00000100:00100000:0.0:1790919138.530447:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532513408 00000100:00100000:0.0:1790919138.530511:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 145 00000100:00100000:0.0:1790919138.530522:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+22:11344:x1877914532513408:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:0.0:1790919138.530577:0:8231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919138.530600:0:8231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c4c4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cde1 expref: -99 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919138.530716:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c4c54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919138.530730:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c4c54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919138.530742:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c4c54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919138.530752:0:8231:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1790919138.530893:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c4c4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cde1 expref: 25 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919138.530912:0:8231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c4c54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cde1 expref: 24 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919138.530922:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be88e22500) 00010000:00010000:0.0:1790919138.530924:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790919138.530928:0:8231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac58a00, rc 0) 00000100:00100000:0.0:1790919138.530992:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+24:11344:x1877914532513408:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 472us (655us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1790919138.530999:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 145 00000100:00100000:3.0:1790919138.535575:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919138.538457:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919138.538572:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532513792 00000100:00100000:1.0:1790919138.538595:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532513792 00000100:00100000:1.0:1790919138.538661:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 11 00000100:00100000:1.0:1790919138.538671:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+24:2351:x1877914532513792:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790919138.538686:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919138.538710:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c4c54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cde1 expref: 24 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919138.538730:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be88e22500) 00010000:00010000:1.0:1790919138.538735:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919138.538798:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+23:2351:x1877914532513792:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 128us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919138.538805:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 11 00000100:00100000:2.0:1790919138.539697:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532513664 00000100:00100000:2.0:1790919138.539705:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532513664 00000100:00100000:2.0:1790919138.539740:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 146 00000100:00100000:2.0:1790919138.539748:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+23:11344:x1877914532513664:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:2.0:1790919138.539782:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919138.539800:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4c62 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cde8 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.539891:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4c69 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.539906:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4c69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.539931:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4c69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919138.539944:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1790919138.540094:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4c62 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cde8 expref: 26 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.540111:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4c69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cde8 expref: 25 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.540119:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be88e22500) 00010000:00010000:2.0:1790919138.540417:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790919138.540422:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be88387200, rc 0) 00000100:00100000:2.0:1790919138.540487:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+25:11344:x1877914532513664:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 740us (4972us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1790919138.540495:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 146 00000100:00100000:3.0:1790919138.546803:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919138.546875:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532513920 00000100:00100000:2.0:1790919138.546884:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532513920 00000100:00100000:2.0:1790919138.546940:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 49 00000100:00100000:2.0:1790919138.546949:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2353:x1877914532513920:12345-192.168.201.27@tcp:1:lfs.0 00010000:00010000:2.0:1790919138.546992:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6f6e2c1/0xc3296956897c4c77 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.547022:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007beff5c6/0xc3296956897c4c2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdcc expref: 6 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.547031:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919138.547056:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790919138.547061:0:6698:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6f6e2c1/0xc3296956897c4c77 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.547102:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007beff5c6/0xc3296956897c4c2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdcc expref: 6 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.547117:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007beff5c6/0xc3296956897c4c2a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdcc expref: 6 pid: 6700 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919138.547140:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf751c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6698:1877914550346368:192.168.201.27@tcp:104: 00000100:00100000:2.0:1790919138.547223:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be838f8240 going to sleep for 11 seconds 00000100:00100000:3.0:1790919138.550237:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919138.550350:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532514048 00000100:00100000:0.0:1790919138.550359:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532514048 00002000:00100000:0.0:1790919138.550409:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff88beb3b17b80 x1877914532514048/t0(0) o4->c4a4e085-55d7-40e9-993c-11b4dfc2d5f5@192.168.201.27@tcp:259/0 lens 504/0 e 0 to 0 dl 1790919149 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790919138.550421:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88beb3b17b80 with x1877914532514048 ext(0->12) 00010000:00010000:0.0:1790919138.550445:0:6704:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007beff5c6/0xc3296956897c4c2a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdcc expref: 7 pid: 6700 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919138.550462:0:6704:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007beff5c6/0xc3296956897c4c2a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdcc expref: 7 pid: 6700 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790919138.550470:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88beb3b17b80 00000100:00100000:0.0:1790919138.550505:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 2 00000100:00100000:0.0:1790919138.550516:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:2352:x1877914532514048:12345-192.168.201.27@tcp:4:lfs.0 00000100:00100000:0.0:1790919138.551081:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+9:2352:x1877914532514048:12345-192.168.201.27@tcp:4:lfs.0 Request processed in 564us (849us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1790919138.551089:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 2 00002000:00100000:0.0:1790919138.551097:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff88beb3b17b80 x1877914532514048/t4294967305(0) o4->c4a4e085-55d7-40e9-993c-11b4dfc2d5f5@192.168.201.27@tcp:259/0 lens 504/448 e 0 to 0 dl 1790919149 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790919138.551106:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88beb3b17b80 with x1877914532514048 ext(0->12) 00010000:00010000:0.0:1790919138.551112:0:6704:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007beff5c6/0xc3296956897c4c2a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdcc expref: 9 pid: 6700 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919138.551124:0:6704:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007beff5c6/0xc3296956897c4c2a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdcc expref: 9 pid: 6700 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790919138.551131:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88beb3b17b80 00000100:00100000:2.0:1790919138.551397:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf751c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6698:1877914550346368:192.168.201.27@tcp:104: 00010000:00010000:2.0:1790919138.551423:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b6f6e2c1/0xc3296956897c4c77 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919138.558044:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919138.558252:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532514176 00000100:00100000:2.0:1790919138.558271:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532514176 00010000:00010000:2.0:1790919138.558315:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007beff5c6/0xc3296956897c4c2a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdcc expref: 9 pid: 6700 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919138.558357:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 62 00000100:00100000:2.0:1790919138.558367:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+9:2353:x1877914532514176:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790919138.558383:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1790919138.558403:0:5830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1790919138.558406:0:5830:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1790919139 00002000:00010000:2.0:1790919138.558418:0:5830:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1790919139 00002000:00010000:2.0:1790919138.558421:0:5830:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1790919139 00010000:00010000:2.0:1790919138.558427:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007beff5c6/0xc3296956897c4c2a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdcc expref: 9 pid: 6700 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.558442:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007beff5c6/0xc3296956897c4c2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdcc expref: 9 pid: 6700 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.558463:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007beff5c6/0xc3296956897c4c2a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdcc expref: 9 pid: 6700 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.558480:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790919138.558484:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790919138.558490:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b6f6e2c1/0xc3296956897c4c77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.558500:0:5830:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6f6e2c1/0xc3296956897c4c77 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.558588:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919138.558641:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+8:2353:x1877914532514176:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 275us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919138.558649:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 62 00010000:00010000:0.0:1790919138.559722:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b6f6e2c1/0xc3296956897c4c77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919138.559736:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6f6e2c1/0xc3296956897c4c77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919138.559791:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6f6e2c1/0xc3296956897c4c77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919138.559800:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6f6e2c1/0xc3296956897c4c77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919138.559807:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6f6e2c1/0xc3296956897c4c77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919138.559813:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386c00 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:0.0:1790919138.559817:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6f6e2c1/0xc3296956897c4c77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919138.559825:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6f6e2c1/0xc3296956897c4c77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919138.559844:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6f6e2c1/0xc3296956897c4c77 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919138.559852:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6f6e2c1/0xc3296956897c4c77 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919138.559932:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:2353:x1877914532513920:12345-192.168.201.27@tcp:1:lfs.0 Request processed in 12981us (13137us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919138.559940:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 49 00010000:00010000:2.0:1790919138.561028:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919138.563670:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919138.563769:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532514432 00000100:00100000:2.0:1790919138.563779:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532514432 00000100:00100000:2.0:1790919138.563836:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 38 00000100:00100000:2.0:1790919138.563847:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be92908450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+25:11344:x1877914532514432:12345-192.168.201.27@tcp:35:lfs.0 00000004:00010000:2.0:1790919138.563927:0:5849:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4c69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cde8 expref: 25 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790919138.564574:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:2.0:1790919138.564620:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:3.0:1790919138.565640:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:3.0:1790919138.565718:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4c7e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919138.565735:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c4c15 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdbe expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919138.565744:0:5849:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4c7e lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919138.565794:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c4c15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdbe expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919138.565824:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c4c15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdbe expref: 29 pid: 5845 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919138.565838:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b16a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5849:1877914550346496:192.168.201.27@tcp:104: 00000100:00100000:3.0:1790919138.565926:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be838f8240 going to sleep for 11 seconds 00000100:00100000:3.0:1790919138.569413:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919138.569574:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b16a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5849:1877914550346496:192.168.201.27@tcp:104: 00010000:00010000:1.0:1790919138.569601:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4c7e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919138.569683:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532514560 00000100:00100000:0.0:1790919138.569691:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532514560 00010000:00010000:0.0:1790919138.569734:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c4c15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdbe expref: 30 pid: 5845 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919138.569844:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 63 00000100:00100000:0.0:1790919138.569854:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+30:2352:x1877914532514560:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790919138.569869:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919138.569876:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c4c15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdbe expref: 30 pid: 5845 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919138.569888:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c4c15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdbe expref: 30 pid: 5845 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919138.569910:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c4c15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdbe expref: 30 pid: 5845 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919138.569926:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be88e22500) 00010000:00010000:0.0:1790919138.569930:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4c7e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919138.569939:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4c7e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919138.569946:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4c7e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919138.569974:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919138.570035:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+29:2352:x1877914532514560:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 182us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919138.570055:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 63 00010000:00010000:1.0:1790919138.570118:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4c7e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919138.570134:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4c7e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790919138.570377:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1790919138.570609:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:1.0:1790919138.570713:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beba03d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1877914550346624:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1790919138.571278:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919138.571307:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be91c84540 going to sleep for 11 seconds 00000100:00100000:0.0:1790919138.571904:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550346624 00000100:00100000:0.0:1790919138.571913:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550346624 00000100:00100000:0.0:1790919138.571973:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790919138.571982:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba03fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5849:x1877914550346624:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790919138.572083:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba03fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5849:x1877914550346624:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 102us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919138.572090:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790919138.572784:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beba03d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1877914550346624:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1790919138.573723:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1790919138.574459:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beba03d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1877914550346752:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1790919138.574595:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919138.574630:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be91c84240 going to sleep for 11 seconds 00000100:00100000:0.0:1790919138.574737:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550346752 00000100:00100000:0.0:1790919138.574745:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550346752 00000100:00100000:0.0:1790919138.574806:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790919138.574816:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba03c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5849:x1877914550346752:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790919138.575038:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba03c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5849:x1877914550346752:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 224us (512us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1790919138.575057:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790919138.575494:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beba03d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1877914550346752:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1790919138.575600:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:1.0:1790919138.575642:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4c7e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919138.575654:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4c7e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919138.575662:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4c7e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919138.575669:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81673800 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:1.0:1790919138.575673:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4c7e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919138.575681:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4c7e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919138.575696:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be88e22500) 00010000:00010000:1.0:1790919138.575699:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1790919138.575704:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4c7e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919138.575710:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4c7e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790919138.576018:0:5849:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1790919138.576444:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:1.0:1790919138.576455:0:5849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 340464928408ns, next at 341464926210ns, rc = 0 00000001:00080000:1.0:1790919138.576463:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1790919138.576498:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be88e22500) 00010000:00010000:1.0:1790919138.576501:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1790919138.576510:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4c69 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cde8 expref: 33 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1790919138.576637:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790919138.577481:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be92908450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+32:11344:x1877914532514432:12345-192.168.201.27@tcp:35:lfs.0 Request processed in 13630us (13817us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1790919138.577492:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 38 00000020:00080000:1.0:1790919138.577498:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1790919138.580712:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919138.580881:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532514688 00000100:00100000:0.0:1790919138.580891:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532514688 00000100:00100000:0.0:1790919138.580987:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 147 00000100:00100000:0.0:1790919138.580999:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+32:11344:x1877914532514688:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:0.0:1790919138.581035:0:8231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919138.581058:0:8231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59c00/0xc3296956897c4c85 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cdef expref: -99 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919138.581117:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59c00/0xc3296956897c4c85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdef expref: 33 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919138.581225:0:8231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59c00/0xc3296956897c4c85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdef expref: 33 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919138.581245:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be853b5e00) 00010000:00010000:0.0:1790919138.581248:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790919138.581251:0:8231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac59c00, rc 0) 00000100:00100000:0.0:1790919138.581422:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+33:11344:x1877914532514688:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 425us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919138.581429:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 147 00000100:00100000:0.0:1790919138.584667:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919138.584756:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532514944 00000100:00100000:1.0:1790919138.584776:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532514944 00000100:00100000:1.0:1790919138.584833:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 39 00000100:00100000:1.0:1790919138.584844:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be85f38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+33:11344:x1877914532514944:12345-192.168.201.27@tcp:35:lfs.0 00000100:00100000:1.0:1790919138.585084:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be85f38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+34:11344:x1877914532514944:12345-192.168.201.27@tcp:35:lfs.0 Request processed in 241us (426us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1790919138.585091:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 39 00000100:00100000:1.0:1790919138.696649:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919138.696911:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532515200 00000100:00100000:2.0:1790919138.696922:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532515200 00000100:00100000:2.0:1790919138.696984:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 148 00000100:00100000:2.0:1790919138.696996:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba03c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+34:11354:x1877914532515200:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:2.0:1790919138.697053:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919138.697078:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4c8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cdf6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919138.697198:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1790919138.697337:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4c8c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdf6 expref: 36 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.697352:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be85efc000) 00010000:00010000:2.0:1790919138.697356:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790919138.697361:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4c8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdf6 expref: 36 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.697374:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be88387400, rc 0) 00000100:00100000:2.0:1790919138.697434:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba03c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+35:11354:x1877914532515200:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 440us (797us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1790919138.697442:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 148 00000100:00100000:3.0:1790919138.703766:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919138.704271:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532515328 00000100:00100000:2.0:1790919138.704297:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532515328 00000100:00100000:2.0:1790919138.704360:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 149 00000100:00100000:2.0:1790919138.704371:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+35:11354:x1877914532515328:12345-192.168.201.27@tcp:34:lfs.0 00010000:00010000:2.0:1790919138.704451:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4c9a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.704470:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4c9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.704483:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4c9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.704497:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4ca1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.704504:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4ca1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.704510:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4ca1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.704638:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4ca8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.704647:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.704654:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790919138.704697:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.704719:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4c9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.704726:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4c9a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.704732:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4c9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.704737:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88387400 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919138.704742:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4c9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.704762:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4c9a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.704774:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88be85efcd00) 00010000:00010000:2.0:1790919138.704777:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919138.704782:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4c9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.704788:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4c9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.704799:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4ca1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.704805:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4ca1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.704810:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4ca1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.704821:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88387200 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919138.704824:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4ca1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.704830:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4ca1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.704837:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88be85efc600) 00010000:00010000:2.0:1790919138.704840:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919138.704842:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4ca1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.704848:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4ca1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.704866:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.704872:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4ca8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.704878:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4ca8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.704883:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386600 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919138.704885:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4ca8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.704891:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4ca8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.704909:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be853b5e00) 00010000:00010000:2.0:1790919138.704911:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919138.704914:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4ca8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.704921:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4ca8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919138.705019:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+35:11354:x1877914532515328:12345-192.168.201.27@tcp:34:lfs.0 Request processed in 647us (1419us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919138.705027:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 149 00000100:00100000:0.0:1790919138.709315:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919138.709474:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532515584 00000100:00100000:1.0:1790919138.709483:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532515584 00000100:00100000:1.0:1790919138.709581:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 40 00000100:00100000:1.0:1790919138.709591:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+35:11354:x1877914532515584:12345-192.168.201.27@tcp:35:lfs.0 00000100:00100000:1.0:1790919138.709853:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+36:11354:x1877914532515584:12345-192.168.201.27@tcp:35:lfs.0 Request processed in 263us (552us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1790919138.709873:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 40 00000100:00100000:1.0:1790919138.759185:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919138.759516:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532515840 00000100:00100000:2.0:1790919138.759573:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532515840 00000100:00100000:2.0:1790919138.759650:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 150 00000100:00100000:2.0:1790919138.759662:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+36:11357:x1877914532515840:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:2.0:1790919138.759691:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919138.759713:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4caf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cdfd expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.759814:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4cb6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.759830:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4cb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.759841:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4cb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.759855:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4cbd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.759877:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4cbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.759884:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4cbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.760018:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4cc4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.760027:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4cc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.760033:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4cc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919138.760053:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1790919138.760171:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4cb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.760178:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4cb6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.760185:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4cb6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.760191:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88387200 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919138.760196:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4cb6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.760203:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4cb6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.760225:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88be85efcd00) 00010000:00010000:2.0:1790919138.760227:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919138.760233:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4cb6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.760238:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4cb6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.760251:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4cbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.760258:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4cbd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.760263:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4cbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.760268:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88387400 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919138.760270:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4cbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.760276:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4cbd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.760283:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88be85efc600) 00010000:00010000:2.0:1790919138.760285:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919138.760287:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4cbd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.760292:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4cbd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.760346:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4caf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdfd expref: 39 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.760360:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4cc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdfd expref: 38 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.760367:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be853b5e00) 00010000:00010000:2.0:1790919138.760369:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790919138.760371:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be88386c00, rc 0) 00000100:00100000:2.0:1790919138.760433:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+38:11357:x1877914532515840:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 773us (1259us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1790919138.760440:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 150 00000100:00100000:3.0:1790919138.766510:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919138.766736:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532515968 00000100:00100000:2.0:1790919138.766748:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532515968 00000100:00100000:2.0:1790919138.766824:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 151 00000100:00100000:2.0:1790919138.766834:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+38:11357:x1877914532515968:12345-192.168.201.27@tcp:54:lfs.0 00010000:00010000:2.0:1790919138.766913:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4cd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.766932:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.766943:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.766969:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.766996:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4cd2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.767011:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4cd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.767018:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386600 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919138.767023:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4cd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.767031:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4cd2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.767044:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be853b5e00) 00010000:00010000:2.0:1790919138.767046:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790919138.767051:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4cd2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919138.767056:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4cd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919138.767147:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+38:11357:x1877914532515968:12345-192.168.201.27@tcp:54:lfs.0 Request processed in 314us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919138.767154:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 151 00000100:00100000:0.0:1790919138.770174:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919138.770351:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532516224 00000100:00100000:1.0:1790919138.770363:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532516224 00000100:00100000:1.0:1790919138.770421:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 41 00000100:00100000:1.0:1790919138.770431:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba216a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+38:11357:x1877914532516224:12345-192.168.201.27@tcp:35:lfs.0 00000100:00100000:1.0:1790919138.770705:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba216a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+39:11357:x1877914532516224:12345-192.168.201.27@tcp:35:lfs.0 Request processed in 274us (537us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1790919138.770713:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 41 00000100:00100000:1.0:1790919139.022364:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919139.022417:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919139.022474:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919139.022613:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532516352 00000100:00100000:0.0:1790919139.022624:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532516352 00000100:00100000:0.0:1790919139.022681:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 295 00000100:00100000:0.0:1790919139.022690:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+13:2351:x1877914532516352:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:0.0:1790919139.022775:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+13:2351:x1877914532516352:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 85us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919139.022782:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 295 00000100:00100000:3.0:1790919139.023917:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532516480 00000100:00100000:3.0:1790919139.023928:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532516480 00000100:00100000:3.0:1790919139.023994:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 88 00000100:00100000:3.0:1790919139.024013:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf732300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2351:x1877914532516480:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1790919139.024088:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf732300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2351:x1877914532516480:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 78us (1614us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919139.024096:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 88 00000100:00080000:0.0:1790919139.024887:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790919139.026552:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532516608 00000100:00100000:2.0:1790919139.026567:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532516608 00000100:00100000:2.0:1790919139.026669:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 151 00000100:00100000:2.0:1790919139.026678:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf789880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5591729f-44f1-43f1-b042-c3a508737d97+5:2351:x1877914532516608:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:2.0:1790919139.026786:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf789880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5591729f-44f1-43f1-b042-c3a508737d97+5:2351:x1877914532516608:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 108us (4368us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919139.026808:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 151 00000100:00080000:0.0:1790919139.026949:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790919139.045685:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919139.046010:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532516864 00000100:00100000:2.0:1790919139.046022:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532516864 00000100:00100000:2.0:1790919139.046098:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 152 00000100:00100000:2.0:1790919139.046108:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba215c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+39:11388:x1877914532516864:12345-192.168.201.27@tcp:101:cat.0 00010000:00010000:2.0:1790919139.046141:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919139.046166:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4cd9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672ce04 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.046269:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4ce0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.046285:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4ce0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.046296:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4ce0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919139.046309:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1790919139.046439:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4cd9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce04 expref: 42 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.046460:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4ce0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce04 expref: 41 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.046468:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be853b5e00) 00010000:00010000:2.0:1790919139.046471:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790919139.046474:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be88387400, rc 0) 00000100:00100000:2.0:1790919139.046613:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba215c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+41:11388:x1877914532516864:12345-192.168.201.27@tcp:101:cat.0 Request processed in 506us (937us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1790919139.046620:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 152 00000100:00100000:1.0:1790919139.053082:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919139.053754:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532517120 00000100:00100000:2.0:1790919139.053768:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532517120 00000100:00100000:2.0:1790919139.053836:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 42 00000100:00100000:2.0:1790919139.053847:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+41:11388:x1877914532517120:12345-192.168.201.27@tcp:35:cat.0 00000100:00100000:2.0:1790919139.054444:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+42:11388:x1877914532517120:12345-192.168.201.27@tcp:35:cat.0 Request processed in 595us (1371us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1790919139.054453:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 42 00000100:00100000:1.0:1790919139.056432:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919139.059640:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532517248 00000100:00100000:2.0:1790919139.059653:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532517248 00000100:00100000:2.0:1790919139.059725:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 12 00000100:00100000:2.0:1790919139.059733:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be91cac850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+42:2351:x1877914532517248:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790919139.059754:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919139.059776:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4ce0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce04 expref: 42 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.059792:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be853b5e00) 00010000:00010000:2.0:1790919139.059796:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919139.059856:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be91cac850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+41:2351:x1877914532517248:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 125us (3438us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919139.059861:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 12 00000100:00100000:2.0:1790919139.114641:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919139.114680:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532517504 00000100:00100000:2.0:1790919139.114690:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532517504 00000100:00100000:2.0:1790919139.114752:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 153 00000100:00100000:2.0:1790919139.114761:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf750a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+41:11394:x1877914532517504:12345-192.168.201.27@tcp:101:dd.0 00010000:00010000:2.0:1790919139.114785:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919139.114788:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1790919139.114816:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c4c46 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdda expref: 41 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.114835:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88be85efcd00) 00010000:00010000:2.0:1790919139.114840:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790919139.114852:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4cee lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672ce0b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.114946:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4cf5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.114960:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4cc4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdfd expref: 41 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.114969:0:5847:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4cf5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.115010:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4cc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdfd expref: 41 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.115022:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4cc4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdfd expref: 41 pid: 5847 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919139.115035:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf753800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1877914550346880:192.168.201.27@tcp:104: 00000100:00100000:2.0:1790919139.115335:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be812edb40 going to sleep for 11 seconds 00000100:00100000:0.0:1790919139.121556:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919139.122845:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532517632 00000100:00100000:1.0:1790919139.122862:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532517632 00010000:00010000:1.0:1790919139.122907:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4cc4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdfd expref: 42 pid: 5847 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919139.123285:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 64 00000100:00100000:1.0:1790919139.123297:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba214e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+42:2353:x1877914532517632:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790919139.123313:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919139.123320:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4cc4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdfd expref: 42 pid: 5847 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919139.123335:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4cc4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdfd expref: 42 pid: 5847 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919139.123368:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be853b5e00) 00010000:00010000:1.0:1790919139.123373:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4cf5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919139.123382:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4cf5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919139.123390:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4cf5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919139.123407:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919139.123463:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba214e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+42:2353:x1877914532517632:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 169us (1946us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919139.123471:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 64 00010000:00010000:2.0:1790919139.124144:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c4cc4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdfd expref: 41 pid: 5847 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919139.124163:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf753800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1877914550346880:192.168.201.27@tcp:104: 00010000:00010000:2.0:1790919139.124186:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4cf5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.124196:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4cf5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.124202:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4cf5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919139.124222:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1790919139.124463:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c4cee lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce0b expref: 42 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.124478:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4cf5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce0b expref: 41 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.124485:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be853b5e00) 00010000:00010000:2.0:1790919139.124488:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790919139.124491:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be88386600, rc 0) 00000100:00100000:2.0:1790919139.124559:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf750a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+41:11394:x1877914532517504:12345-192.168.201.27@tcp:101:dd.0 Request processed in 9798us (9928us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1790919139.124567:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 153 00000100:00100000:2.0:1790919139.127636:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919139.127691:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532517888 00000100:00100000:2.0:1790919139.127703:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532517888 00000100:00100000:2.0:1790919139.127759:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 154 00000100:00100000:2.0:1790919139.127770:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf753800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+41:11394:x1877914532517888:12345-192.168.201.27@tcp:36:dd.0 00010000:00010000:2.0:1790919139.128088:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4d03 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.128110:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4d03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.128133:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4d03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790919139.128193:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1790919139.128220:0:5846:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007edd3710 reply state 00000000d868fb47 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4d03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919139.128229:0:5846:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790919139.128330:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf753800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+44:11394:x1877914532517888:12345-192.168.201.27@tcp:36:dd.0 Request processed in 561us (703us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1790919139.128338:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 154 00000020:00080000:2.0:1790919139.128344:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790919139.133866:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4d03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919139.133903:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4d03 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919139.133911:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4d03 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919139.133918:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88387200 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919139.133923:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4d03 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919139.133932:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4d03 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919139.133951:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be853b5e00) 00010000:00010000:0.0:1790919139.133953:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919139.133959:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4d03 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919139.133965:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c4d03 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790919139.150063:0:5869:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967421 is committed 00000001:00080000:0.0:1790919139.150086:0:5869:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967436 is committed 00000004:00080000:0.0:1790919139.150095:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1790919139.150298:0:5869:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88be91c84540 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1790919139.150305:0:5869:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88be903df800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88be91c84000 00000020:00080000:0.0:1790919139.150308:0:5869:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88be903df300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88bebacf9c00 00000020:00080000:1.0:1790919139.150345:0:5880:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1790919139.150559:0:5880:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:0.0:1790919139.150886:0:5869:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967438 is committed 00000100:00100000:3.0:1790919139.151207:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790919139.151228:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beba215880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550347008:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1790919139.151300:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919139.151706:0:10350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550347008 00000100:00100000:1.0:1790919139.151716:0:10350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550347008 00000100:00100000:1.0:1790919139.151841:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790919139.151852:0:10350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1877914550347008:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1790919139.151883:0:10350:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:1.0:1790919139.151917:0:10350:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6abf41e3, atime: 0x6abf41e3, ctime: 0x6abf41e3, blocks: 0x1 00010000:00010000:1.0:1790919139.151927:0:10350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000036b1391/0xc3296956897c4d0a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919139.151944:0:10350:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=341s v=(0 0) 00010000:00010000:1.0:1790919139.151949:0:10350:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919139.151970:0:10350:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000036b1391/0xc3296956897c4d0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919139.151987:0:10350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000036b1391/0xc3296956897c4d0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919139.152006:0:10350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000036b1391/0xc3296956897c4d0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919139.152015:0:10350:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000036b1391/0xc3296956897c4d0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919139.152041:0:10350:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790919139.152067:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790919139.152086:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000036b1391/0xc3296956897c4d0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.152094:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88beb3f7e400 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:3.0:1790919139.152105:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000036b1391/0xc3296956897c4d0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.152114:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000036b1391/0xc3296956897c4d0a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.152135:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000036b1391/0xc3296956897c4d0a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.152142:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000036b1391/0xc3296956897c4d0a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.152168:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919139.152170:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919139.152171:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919139.153936:0:10350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3306:x1877914550347008:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2079us (2628us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1790919139.153948:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:3.0:1790919139.154097:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88beba215880/2, rc 0, transno 4294967307 00000100:00100000:3.0:1790919139.154105:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beba215880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550347008:0@lo:6:osp-syn-1-0.0 00000040:00080000:0.0:1790919139.328438:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790919139.328463:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790919139.328978:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1790919139.328987:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790919139.350468:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919139.350572:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532518016 00000100:00100000:3.0:1790919139.350582:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532518016 00000100:00100000:3.0:1790919139.350648:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 155 00000100:00100000:3.0:1790919139.350659:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf751c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+19:11408:x1877914532518016:12345-192.168.201.27@tcp:101:stat.0 00010000:00010000:3.0:1790919139.350683:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919139.350704:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4d11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672ce12 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.350760:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4d18 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.350785:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4d18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.350793:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4d18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.350804:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4d1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.350809:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4d1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.350813:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4d1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.351068:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c4d26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.351088:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4cf5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce0b expref: 20 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.351096:0:5845:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c4d26 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.351129:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4cf5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce0b expref: 20 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.351143:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4cf5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce0b expref: 20 pid: 5847 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919139.351169:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b16300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1877914550347136:192.168.201.27@tcp:104: 00000100:00100000:3.0:1790919139.351279:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be81377c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790919139.353362:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b16300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1877914550347136:192.168.201.27@tcp:104: 00000100:00100000:2.0:1790919139.353385:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00010000:00010000:3.0:1790919139.353390:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c4d26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919139.353462:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532518272 00000100:00100000:1.0:1790919139.353469:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532518272 00000100:00100000:1.0:1790919139.353520:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 43 00000100:00100000:1.0:1790919139.353553:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf750e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+21:5589:x1877914532518272:12345-192.168.201.27@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1790919139.353853:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf750e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+22:5589:x1877914532518272:12345-192.168.201.27@tcp:35:ldlm_bl.0 Request processed in 324us (467us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1790919139.353861:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 43 00000100:00100000:2.0:1790919139.356005:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919139.356056:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532518400 00000100:00100000:0.0:1790919139.356065:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532518400 00010000:00010000:0.0:1790919139.356156:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4cf5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce0b expref: 22 pid: 5847 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919139.356194:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 65 00000100:00100000:0.0:1790919139.356204:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf752d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+22:2352:x1877914532518400:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790919139.356218:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919139.356223:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4cf5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce0b expref: 22 pid: 5847 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919139.356233:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4cf5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce0b expref: 22 pid: 5847 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919139.356337:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c4cf5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce0b expref: 22 pid: 5847 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919139.356350:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be853b5e00) 00010000:00010000:0.0:1790919139.356354:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c4d26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919139.356361:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c4d26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919139.356366:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c4d26 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919139.356431:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919139.356474:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf752d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+21:2352:x1877914532518400:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 272us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919139.356482:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 65 00010000:00010000:3.0:1790919139.356829:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c4d26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.356840:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c4d26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919139.356887:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1790919139.356891:0:5845:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790919139.356916:0:5845:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c4d26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.356929:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c4d26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.356939:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4d18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.356945:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4d18 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.356952:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4d18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.356967:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81672c00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919139.356978:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4d18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.356987:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4d18 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.357007:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88be85efcd00) 00010000:00010000:3.0:1790919139.357010:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919139.357013:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4d18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.357019:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4d18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.357030:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4d1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.357036:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4d1f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.357041:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4d1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.357046:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81673800 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919139.357049:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4d1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.357055:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4d1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.357062:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88be88e22100) 00010000:00010000:3.0:1790919139.357064:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919139.357211:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4d1f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.357218:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4d1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.357324:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4d11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce12 expref: 21 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.357339:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c4d26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce12 expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.357346:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be853b5e00) 00010000:00010000:3.0:1790919139.357348:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790919139.357350:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81672400, rc 0) 00000100:00100000:3.0:1790919139.357419:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf751c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+20:11408:x1877914532518016:12345-192.168.201.27@tcp:101:stat.0 Request processed in 6763us (6961us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919139.357425:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 155 00000100:00100000:2.0:1790919139.413912:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919139.415724:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532518656 00000100:00100000:0.0:1790919139.415737:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532518656 00000100:00100000:0.0:1790919139.415817:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 156 00000100:00100000:0.0:1790919139.415828:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf752a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+20:11414:x1877914532518656:12345-192.168.201.27@tcp:36:truncate.0 00010000:00010000:0.0:1790919139.415887:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919139.415911:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c4d26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce12 expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919139.415927:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be853b5e00) 00010000:00010000:0.0:1790919139.415930:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790919139.416443:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c4d2d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919139.416455:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c4d2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919139.416462:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c4d2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790919139.416498:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1790919139.416513:0:5846:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000965b716c reply state 0000000075be370c transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c4d2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919139.416519:0:5846:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790919139.417191:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf752a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+22:11414:x1877914532518656:12345-192.168.201.27@tcp:36:truncate.0 Request processed in 1361us (3284us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1790919139.417200:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 156 00000020:00080000:0.0:1790919139.417206:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790919139.421908:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c4d2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.421925:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c4d2d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.421933:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c4d2d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.421938:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac58200 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919139.421942:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c4d2d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.421977:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c4d2d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.422001:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be853b5e00) 00010000:00010000:3.0:1790919139.422004:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919139.422010:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c4d2d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.422016:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c4d2d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919139.544374:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919139.544705:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532518784 00000100:00100000:0.0:1790919139.544715:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532518784 00000100:00100000:0.0:1790919139.544780:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 157 00000100:00100000:0.0:1790919139.544790:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf751880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+21:11428:x1877914532518784:12345-192.168.201.27@tcp:101:stat.0 00010000:00010000:0.0:1790919139.544818:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919139.544840:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4d34 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672ce19 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919139.544914:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4d3b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919139.544931:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4d3b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919139.544943:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4d3b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919139.544970:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c4d42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919139.544979:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c4d42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919139.544985:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c4d42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919139.545493:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4d49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919139.545893:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4d49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919139.545901:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4d49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919139.545935:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1790919139.545938:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790919139.545963:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4d49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919139.545971:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4d49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919139.545978:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4d3b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919139.545982:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4d3b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919139.545987:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4d3b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919139.546000:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac59a00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919139.546005:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4d3b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919139.546012:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4d3b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919139.546028:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88be85efcd00) 00010000:00010000:0.0:1790919139.546037:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919139.546043:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4d3b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919139.546049:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4d3b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919139.546065:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c4d42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919139.546189:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c4d42 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919139.546198:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c4d42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919139.546203:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac58c00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919139.546206:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c4d42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919139.546213:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c4d42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919139.546222:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88be853b5800) 00010000:00010000:0.0:1790919139.546225:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919139.546228:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c4d42 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919139.546234:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c4d42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919139.546381:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4d34 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce19 expref: 23 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919139.546403:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4d49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce19 expref: 22 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919139.546408:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be853b5e00) 00010000:00010000:0.0:1790919139.546410:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790919139.546411:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac59000, rc 0) 00000100:00100000:0.0:1790919139.548007:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf751880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+22:11428:x1877914532518784:12345-192.168.201.27@tcp:101:stat.0 Request processed in 3200us (3627us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919139.548018:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 157 00010000:00010000:3.0:1790919139.583839:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919139.638596:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919139.638677:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532519040 00000100:00100000:2.0:1790919139.638688:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532519040 00000100:00100000:2.0:1790919139.638755:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 158 00000100:00100000:2.0:1790919139.638778:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba216d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+22:11439:x1877914532519040:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:2.0:1790919139.638799:0:8231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919139.638819:0:8231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fc00/0xc3296956897c4d50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672ce20 expref: -99 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919139.638904:0:8231:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1790919139.639035:0:8231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fc00/0xc3296956897c4d50 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce20 expref: 24 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.639061:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be85efc000) 00010000:00010000:2.0:1790919139.639065:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790919139.639070:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fc00/0xc3296956897c4d50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce20 expref: 24 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.639083:0:8231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be90f9fc00, rc 0) 00000100:00100000:2.0:1790919139.639164:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba216d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+23:11439:x1877914532519040:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 387us (577us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1790919139.639171:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 158 00000100:00100000:2.0:1790919139.645074:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919139.645418:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532519296 00000100:00100000:1.0:1790919139.645429:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532519296 00000100:00100000:1.0:1790919139.645491:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 44 00000100:00100000:1.0:1790919139.645501:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be92908850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+23:11439:x1877914532519296:12345-192.168.201.27@tcp:35:lfs.0 00000100:00100000:1.0:1790919139.646038:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be92908850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+24:11439:x1877914532519296:12345-192.168.201.27@tcp:35:lfs.0 Request processed in 536us (990us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1790919139.646047:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 44 00000100:00100000:3.0:1790919139.711094:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919139.711218:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532519552 00000100:00100000:2.0:1790919139.711229:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532519552 00000100:00100000:2.0:1790919139.711290:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 159 00000100:00100000:2.0:1790919139.711301:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+24:11445:x1877914532519552:12345-192.168.201.27@tcp:101:bash.0 00010000:00010000:2.0:1790919139.711329:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919139.711354:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fc00/0xc3296956897c4d5e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672ce27 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.711485:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c4d65 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.711499:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4d49 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce19 expref: 25 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.711507:0:5845:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c4d65 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.711577:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4d49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce19 expref: 25 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.711591:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4d49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce19 expref: 25 pid: 5847 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919139.711605:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf750380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1877914550347264:192.168.201.27@tcp:104: 00000100:00100000:2.0:1790919139.711690:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be9584f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919139.716368:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919139.716707:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf750380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1877914550347264:192.168.201.27@tcp:104: 00010000:00010000:2.0:1790919139.716746:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c4d65 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919139.716899:0:8529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532519680 00000100:00100000:3.0:1790919139.716907:0:8529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532519680 00010000:00010000:3.0:1790919139.716944:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4d49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce19 expref: 26 pid: 5847 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919139.716997:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 66 00000100:00100000:3.0:1790919139.717007:0:8529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba214a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+26:2352:x1877914532519680:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919139.717023:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919139.717030:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4d49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce19 expref: 26 pid: 5847 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.717041:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4d49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce19 expref: 26 pid: 5847 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.717063:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4d49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce19 expref: 26 pid: 5847 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.717093:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be853b5e00) 00010000:00010000:3.0:1790919139.717098:0:8529:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c4d65 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.717167:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c4d65 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.717177:0:8529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c4d65 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.717295:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919139.717352:0:8529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba214a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+25:2352:x1877914532519680:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 345us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919139.717359:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 66 00010000:00010000:2.0:1790919139.720312:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c4d65 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.720330:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c4d65 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919139.720357:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1790919139.720578:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fc00/0xc3296956897c4d5e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce27 expref: 26 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.720600:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c4d65 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce27 expref: 25 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.720609:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be853b5e00) 00010000:00010000:2.0:1790919139.720612:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790919139.720616:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be90f9f600, rc 0) 00000100:00100000:2.0:1790919139.720819:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+25:11445:x1877914532519552:12345-192.168.201.27@tcp:101:bash.0 Request processed in 9518us (9734us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1790919139.720829:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 159 00000100:00100000:0.0:1790919139.729286:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919139.729469:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532519936 00000100:00100000:2.0:1790919139.729479:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532519936 00000100:00100000:2.0:1790919139.729625:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 160 00000100:00100000:2.0:1790919139.729636:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba215f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+25:11445:x1877914532519936:12345-192.168.201.27@tcp:36:bash.0 00010000:00010000:2.0:1790919139.729917:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c4d73 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.729934:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c4d73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.729945:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c4d73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790919139.730013:0:8231:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1790919139.730036:0:8231:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001e53ed0c reply state 00000000ba13eebc transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c4d73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919139.730045:0:8231:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790919139.730151:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba215f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+28:11445:x1877914532519936:12345-192.168.201.27@tcp:36:bash.0 Request processed in 517us (874us total) trans 4294967449 rc 0/0 00010000:00010000:3.0:1790919139.732347:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c4d73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.732365:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c4d73 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.732373:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c4d73 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.732380:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be90f9ee00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919139.732384:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c4d73 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.732392:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c4d73 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.732428:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be853b5e00) 00010000:00010000:3.0:1790919139.732431:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919139.732437:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c4d73 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.732443:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c4d73 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919139.732673:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 160 00000020:00080000:2.0:1790919139.732682:0:8231:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1790919139.743289:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919139.743825:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532520064 00000100:00100000:2.0:1790919139.743836:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532520064 00000100:00100000:2.0:1790919139.743895:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 161 00000100:00100000:2.0:1790919139.743905:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba217480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+27:11445:x1877914532520064:12345-192.168.201.27@tcp:101:bash.0 00010000:00010000:2.0:1790919139.743931:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919139.743964:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fc00/0xc3296956897c4d7a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672ce2e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.744070:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f800/0xc3296956897c4d81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.744085:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c4d65 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce27 expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.744094:0:5847:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f800/0xc3296956897c4d81 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.744139:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c4d65 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce27 expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.744153:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c4d65 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce27 expref: 28 pid: 5845 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919139.744167:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf750380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1877914550347392:192.168.201.27@tcp:104: 00000100:00100000:2.0:1790919139.744257:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be88d440c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790919139.747848:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf750380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1877914550347392:192.168.201.27@tcp:104: 00010000:00010000:2.0:1790919139.747882:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f800/0xc3296956897c4d81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919139.759777:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919139.760460:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532520192 00000100:00100000:3.0:1790919139.760472:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532520192 00010000:00010000:3.0:1790919139.760514:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c4d65 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce27 expref: 29 pid: 5845 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919139.760632:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 67 00000100:00100000:3.0:1790919139.760643:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba215500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+29:2353:x1877914532520192:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919139.760660:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919139.760667:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c4d65 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce27 expref: 29 pid: 5845 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.760680:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c4d65 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce27 expref: 29 pid: 5845 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.760703:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c4d65 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce27 expref: 29 pid: 5845 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.760719:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be853b5e00) 00010000:00010000:3.0:1790919139.760724:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f800/0xc3296956897c4d81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.760761:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f800/0xc3296956897c4d81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.760769:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f800/0xc3296956897c4d81 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.760806:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919139.760879:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba215500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+28:2353:x1877914532520192:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 238us (1111us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919139.760886:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 67 00010000:00010000:2.0:1790919139.761499:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f800/0xc3296956897c4d81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.761512:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f800/0xc3296956897c4d81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919139.761571:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1790919139.761575:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790919139.761599:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f800/0xc3296956897c4d81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.761628:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fc00/0xc3296956897c4d7a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce2e expref: 28 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.761644:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f800/0xc3296956897c4d81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce2e expref: 27 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.761652:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be853b5e00) 00010000:00010000:2.0:1790919139.761654:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790919139.761657:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be90f9f800, rc 0) 00000100:00100000:2.0:1790919139.761699:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba217480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+27:11445:x1877914532520064:12345-192.168.201.27@tcp:101:bash.0 Request processed in 17796us (18421us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919139.761706:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 161 00000100:00100000:0.0:1790919139.772139:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919139.772292:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532520448 00000100:00100000:2.0:1790919139.772303:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532520448 00000100:00100000:2.0:1790919139.772368:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 45 00000100:00100000:2.0:1790919139.772394:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba217800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+27:11445:x1877914532520448:12345-192.168.201.27@tcp:35:bash.0 00000100:00100000:2.0:1790919139.772969:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba217800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+28:11445:x1877914532520448:12345-192.168.201.27@tcp:35:bash.0 Request processed in 575us (836us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1790919139.772979:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 45 00000100:00100000:1.0:1790919139.868026:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919139.873390:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532520704 00000100:00100000:0.0:1790919139.873480:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532520704 00000100:00100000:0.0:1790919139.873841:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 162 00000100:00100000:0.0:1790919139.873854:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+28:11455:x1877914532520704:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:0.0:1790919139.873890:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919139.873915:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c4d88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672ce35 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919139.874665:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1790919139.875361:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c4d88 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce35 expref: 30 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919139.875697:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be85efc000) 00010000:00010000:0.0:1790919139.875702:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790919139.875709:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c4d88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce35 expref: 30 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919139.875727:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac59800, rc 0) 00000100:00100000:0.0:1790919139.875918:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+29:11455:x1877914532520704:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 2065us (7899us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1790919139.875927:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 162 00000100:00100000:1.0:1790919139.881122:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919139.884646:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532520832 00000100:00100000:3.0:1790919139.884663:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532520832 00000100:00100000:3.0:1790919139.884800:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 163 00000100:00100000:3.0:1790919139.884813:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf733b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+29:11455:x1877914532520832:12345-192.168.201.27@tcp:34:lfs.0 00010000:00010000:3.0:1790919139.886039:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4d96 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.886058:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4d96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.886071:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4d96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.886087:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4d9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.886094:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4d9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.886101:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4d9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.887357:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4da4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.887372:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4da4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.887382:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4da4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790919139.887511:0:5845:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4da4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.887546:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4d96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.887555:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4d96 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.887562:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4d96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.887567:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81673200 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919139.887571:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4d96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.887579:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4d96 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.887590:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88be85efcd00) 00010000:00010000:3.0:1790919139.887593:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919139.887597:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4d96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.887613:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4d96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.887628:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4d9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.887634:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4d9d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.887640:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4d9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.887646:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81673800 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919139.887649:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4d9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.887654:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4d9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.887661:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88be88e22100) 00010000:00010000:3.0:1790919139.887664:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919139.887667:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4d9d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.887673:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4d9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.887688:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4da4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.887694:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4da4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.887707:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4da4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.887711:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81672c00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919139.887714:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4da4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.887720:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4da4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.887727:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be853b5e00) 00010000:00010000:3.0:1790919139.887729:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919139.887732:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4da4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.887738:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4da4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919139.887975:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf733b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+29:11455:x1877914532520832:12345-192.168.201.27@tcp:34:lfs.0 Request processed in 3161us (6856us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919139.887996:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 163 00000100:00100000:1.0:1790919139.890805:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919139.895902:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532521088 00000100:00100000:2.0:1790919139.895919:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532521088 00000100:00100000:2.0:1790919139.896324:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 46 00000100:00100000:2.0:1790919139.896336:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+29:11455:x1877914532521088:12345-192.168.201.27@tcp:35:lfs.0 00000100:00100000:2.0:1790919139.896652:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+30:11455:x1877914532521088:12345-192.168.201.27@tcp:35:lfs.0 Request processed in 318us (5856us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1790919139.896660:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 46 00000100:00100000:1.0:1790919139.938023:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919139.938439:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532521344 00000100:00100000:2.0:1790919139.938450:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532521344 00000100:00100000:2.0:1790919139.938513:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 164 00000100:00100000:2.0:1790919139.938544:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+30:11458:x1877914532521344:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:2.0:1790919139.938573:0:8231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919139.938595:0:8231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fc00/0xc3296956897c4dab lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672ce3c expref: -99 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.938667:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ec00/0xc3296956897c4db2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.938682:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ec00/0xc3296956897c4db2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.938693:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ec00/0xc3296956897c4db2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.938726:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f200/0xc3296956897c4db9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.938746:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f200/0xc3296956897c4db9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.938753:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f200/0xc3296956897c4db9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.939218:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e400/0xc3296956897c4dc0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.939230:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e400/0xc3296956897c4dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.939238:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e400/0xc3296956897c4dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919139.939248:0:8231:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1790919139.939340:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ec00/0xc3296956897c4db2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.939348:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ec00/0xc3296956897c4db2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.939355:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ec00/0xc3296956897c4db2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.939360:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be90f9ec00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919139.939365:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ec00/0xc3296956897c4db2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.939384:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ec00/0xc3296956897c4db2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.939396:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88be85efcd00) 00010000:00010000:2.0:1790919139.939399:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919139.939404:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ec00/0xc3296956897c4db2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.939410:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ec00/0xc3296956897c4db2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.939423:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f200/0xc3296956897c4db9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.939429:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f200/0xc3296956897c4db9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.939435:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f200/0xc3296956897c4db9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.939440:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be90f9f200 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919139.939443:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f200/0xc3296956897c4db9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.939448:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f200/0xc3296956897c4db9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.939454:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88be85efc900) 00010000:00010000:2.0:1790919139.939457:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919139.939459:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f200/0xc3296956897c4db9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.939472:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f200/0xc3296956897c4db9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.939511:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fc00/0xc3296956897c4dab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce3c expref: 33 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.939523:0:8231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e400/0xc3296956897c4dc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce3c expref: 32 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.939574:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be853b5e00) 00010000:00010000:2.0:1790919139.939576:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790919139.939579:0:8231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be90f9e400, rc 0) 00000100:00100000:2.0:1790919139.939629:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+32:11458:x1877914532521344:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 1108us (1620us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1790919139.939636:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 164 00000100:00100000:0.0:1790919139.942877:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919139.942928:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919139.943066:0:8529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532521600 00000100:00100000:3.0:1790919139.943079:0:8529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532521600 00000100:00100000:3.0:1790919139.943164:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 13 00000100:00100000:3.0:1790919139.943176:0:8529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba214700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+32:2350:x1877914532521600:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919139.943193:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919139.943219:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e400/0xc3296956897c4dc0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce3c expref: 32 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919139.943263:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be853b5e00) 00010000:00010000:3.0:1790919139.943268:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919139.943327:0:8529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba214700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+31:2350:x1877914532521600:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 154us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919139.943335:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 13 00000100:00100000:2.0:1790919139.944006:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532521472 00000100:00100000:2.0:1790919139.944013:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532521472 00000100:00100000:2.0:1790919139.944049:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 165 00000100:00100000:2.0:1790919139.944058:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba216680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+31:11458:x1877914532521472:12345-192.168.201.27@tcp:54:lfs.0 00010000:00010000:2.0:1790919139.944358:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fa00/0xc3296956897c4dce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.944374:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fa00/0xc3296956897c4dce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.944385:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fa00/0xc3296956897c4dce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.944424:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fa00/0xc3296956897c4dce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.944431:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fa00/0xc3296956897c4dce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.944437:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fa00/0xc3296956897c4dce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.944443:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be90f9fa00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919139.944447:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fa00/0xc3296956897c4dce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.944455:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fa00/0xc3296956897c4dce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.944465:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be853b5e00) 00010000:00010000:2.0:1790919139.944469:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790919139.944473:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fa00/0xc3296956897c4dce lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919139.944480:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fa00/0xc3296956897c4dce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919139.944838:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba216680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+31:11458:x1877914532521472:12345-192.168.201.27@tcp:54:lfs.0 Request processed in 780us (1968us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919139.944846:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 165 00000100:00100000:0.0:1790919139.954189:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919139.954396:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532521856 00000100:00100000:1.0:1790919139.954408:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532521856 00000100:00100000:1.0:1790919139.954478:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 47 00000100:00100000:1.0:1790919139.954490:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba214000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+31:11458:x1877914532521856:12345-192.168.201.27@tcp:35:lfs.0 00000100:00100000:1.0:1790919139.954941:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba214000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+32:11458:x1877914532521856:12345-192.168.201.27@tcp:35:lfs.0 Request processed in 451us (762us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1790919139.959233:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 47 00000100:00100000:1.0:1790919140.098301:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919140.098440:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532522112 00000100:00100000:0.0:1790919140.098450:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532522112 00000100:00100000:0.0:1790919140.098523:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 166 00000100:00100000:0.0:1790919140.098562:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+32:11476:x1877914532522112:12345-192.168.201.27@tcp:101:cat.0 00010000:00010000:0.0:1790919140.098587:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919140.098606:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c4dd5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672ce43 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.098693:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4ddc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.098707:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4ddc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.098718:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4ddc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919140.098753:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1790919140.098877:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c4dd5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce43 expref: 35 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.098896:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4ddc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce43 expref: 34 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.098905:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be853b5e00) 00010000:00010000:0.0:1790919140.098908:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1790919140.098911:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac59a00, rc 0) 00000100:00100000:0.0:1790919140.098974:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+34:11476:x1877914532522112:12345-192.168.201.27@tcp:101:cat.0 Request processed in 414us (681us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1790919140.098992:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 166 00000100:00080000:3.0:1790919140.099567:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790919140.126455:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919140.126630:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532522240 00000100:00100000:3.0:1790919140.126640:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532522240 00000100:00100000:3.0:1790919140.126698:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 167 00000100:00100000:3.0:1790919140.126708:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba215180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+34:11477:x1877914532522240:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:3.0:1790919140.127016:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919140.127041:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4dea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672ce4a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.127136:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4df1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.127150:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4df1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.127162:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4df1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919140.127198:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1790919140.127201:0:5845:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790919140.127219:0:5845:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4df1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.127432:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4dea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce4a expref: 36 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.127449:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4df1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce4a expref: 35 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.127458:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88be85efcd00) 00010000:00010000:3.0:1790919140.127461:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790919140.127465:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81673800, rc 0) 00000100:00100000:3.0:1790919140.128286:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba215180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+35:11477:x1877914532522240:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 1574us (1835us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919140.128296:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 167 00000100:00100000:1.0:1790919140.135073:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919140.135179:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532522624 00000100:00100000:2.0:1790919140.135189:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532522624 00000100:00100000:2.0:1790919140.135255:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 48 00000100:00100000:2.0:1790919140.135279:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+35:11477:x1877914532522624:12345-192.168.201.27@tcp:35:lfs.0 00000100:00100000:2.0:1790919140.135640:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+36:11477:x1877914532522624:12345-192.168.201.27@tcp:35:lfs.0 Request processed in 362us (576us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1790919140.135648:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 48 00000100:00100000:1.0:1790919140.138558:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919140.138823:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532522752 00000100:00100000:0.0:1790919140.138834:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532522752 00000100:00100000:0.0:1790919140.138902:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 14 00000100:00100000:0.0:1790919140.138912:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf731880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+36:11477:x1877914532522752:12345-192.168.201.27@tcp:103:lfs.0 00010000:00010000:0.0:1790919140.138929:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1790919140.138955:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f800/0xc3296956897c4d81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce2e expref: 36 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.138986:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4ddc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce43 expref: 35 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.139000:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59c00/0xc3296956897c4c85 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdef expref: 34 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.139025:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be853b5e00) 00010000:00010000:0.0:1790919140.139036:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919140.139093:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf731880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+33:11477:x1877914532522752:12345-192.168.201.27@tcp:103:lfs.0 Request processed in 183us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919140.139101:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 14 00000100:00100000:3.0:1790919140.143742:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919140.145207:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532522880 00000100:00100000:0.0:1790919140.145220:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532522880 00000100:00100000:0.0:1790919140.145403:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 168 00000100:00100000:0.0:1790919140.145415:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+33:11477:x1877914532522880:12345-192.168.201.27@tcp:58:lfs.0 00010000:00010000:0.0:1790919140.145583:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4df8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.145600:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4df8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.145612:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4df8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790919140.146814:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1790919140.146998:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+33:11477:x1877914532522880:12345-192.168.201.27@tcp:58:lfs.0 Request processed in 1581us (3272us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919140.147008:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 168 00000100:00100000:1.0:1790919140.168628:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919140.168753:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532523008 00000100:00100000:0.0:1790919140.168765:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532523008 00000100:00100000:0.0:1790919140.168834:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 169 00000100:00100000:0.0:1790919140.168845:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+33:11479:x1877914532523008:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:0.0:1790919140.168867:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919140.168907:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59c00/0xc3296956897c4dff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672ce51 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.168992:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4e06 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.169007:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4e06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.169019:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4e06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.169033:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c4e0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.169040:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c4e0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.169062:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c4e0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.169391:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4e14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.169401:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4e14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.169408:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4e14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919140.169445:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1790919140.169450:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790919140.169469:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4e14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.169487:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4e14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.169497:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4e06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.169504:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4e06 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.169510:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4e06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.169516:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac59a00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919140.169520:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4e06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.169575:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4e06 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.169588:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88be85efcd00) 00010000:00010000:0.0:1790919140.169591:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919140.169596:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4e06 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.169602:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4e06 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.169614:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c4e0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.169621:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c4e0d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.169633:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c4e0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.169638:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac58c00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919140.169641:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c4e0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.169647:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c4e0d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.169654:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88be853b5e00) 00010000:00010000:0.0:1790919140.169657:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919140.169659:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c4e0d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.169664:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c4e0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.169696:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59c00/0xc3296956897c4dff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce51 expref: 35 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.169708:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4e14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce51 expref: 34 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.169715:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be853b5800) 00010000:00010000:0.0:1790919140.169717:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790919140.169719:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac59e00, rc 0) 00000100:00100000:0.0:1790919140.169781:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+34:11479:x1877914532523008:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 938us (1165us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919140.169797:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 169 00000040:00080000:0.0:1790919140.352281:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790919140.352289:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790919140.352340:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1790919140.352347:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790919140.352463:0:11708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beba216300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11708:1877914550347520:192.168.201.27@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790919140.352567:0:11708:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be85e0d000 going to sleep for 11 seconds 00000100:00100000:3.0:1790919140.356285:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919140.356339:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532523136 00000100:00100000:2.0:1790919140.356350:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532523136 00000100:00100000:0.0:1790919140.356449:0:11708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beba216300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11708:1877914550347520:192.168.201.27@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790919140.356461:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 170 00000100:00100000:2.0:1790919140.356470:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+35:11490:x1877914532523136:12345-192.168.201.27@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790919140.356499:0:8231:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790919140.356627:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+34:11490:x1877914532523136:12345-192.168.201.27@tcp:53:lhsmtool_posix.0 Request processed in 157us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919140.356635:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 170 00000100:00100000:2.0:1790919140.362897:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919140.363345:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532523264 00000100:00100000:0.0:1790919140.363356:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532523264 00000100:00100000:0.0:1790919140.363420:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 171 00000100:00100000:0.0:1790919140.363430:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf750380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+34:11490:x1877914532523264:12345-192.168.201.27@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1790919140.363505:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4e1b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.363557:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4e1b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.363570:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4e1b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.363651:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c4e22 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.363659:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c4e22 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.363666:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c4e22 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.363706:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c4e29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.363715:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c4e29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.363721:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c4e29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919140.363760:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1790919140.363764:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790919140.363778:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c4e29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.363788:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4e1b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.363794:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4e1b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.363801:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4e1b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.363806:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac59a00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919140.363810:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4e1b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.363818:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4e1b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.363828:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88be85efcb00) 00010000:00010000:0.0:1790919140.363838:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919140.363843:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4e1b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.363849:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4e1b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.363862:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c4e22 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.363867:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c4e22 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.363872:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c4e22 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.363877:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac58200 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919140.363880:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c4e22 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.363885:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c4e22 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.363893:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff88be853b5e00) 00010000:00010000:0.0:1790919140.363895:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919140.363898:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c4e22 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.363903:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c4e22 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.363917:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c4e29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.363929:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c4e29 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.363934:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c4e29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.363939:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac59200 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919140.363943:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c4e29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.363949:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c4e29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.363956:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be853b5800) 00010000:00010000:0.0:1790919140.363959:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919140.363962:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c4e29 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.363968:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c4e29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919140.364057:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf750380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+34:11490:x1877914532523264:12345-192.168.201.27@tcp:34:lhsmtool_posix.0 Request processed in 628us (1168us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919140.364065:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 171 00000100:00100000:0.0:1790919140.371076:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919140.371145:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532523520 00000100:00100000:3.0:1790919140.371154:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532523520 00000100:00100000:3.0:1790919140.371203:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 172 00000100:00100000:3.0:1790919140.371212:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba216300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+34:11490:x1877914532523520:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790919140.371232:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919140.371252:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4e30 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672ce58 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.371345:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4e37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.371356:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4e37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.371380:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4e37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919140.371389:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1790919140.371483:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4e37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.371489:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4e37 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.371493:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4e37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.371497:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81673200 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919140.371500:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4e37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.371506:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4e37 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.371517:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be853b5800) 00010000:00010000:3.0:1790919140.371519:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790919140.371555:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4e37 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.371563:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4e37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.371597:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4e30 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce58 expref: 36 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.371613:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88be85efcb00) 00010000:00010000:3.0:1790919140.371614:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790919140.371617:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4e30 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce58 expref: 36 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.371624:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81672c00, rc 0) 00000100:00100000:3.0:1790919140.371671:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba216300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+35:11490:x1877914532523520:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 460us (607us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1790919140.371679:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 172 00000100:00100000:1.0:1790919140.374683:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919140.375012:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532523648 00000100:00100000:0.0:1790919140.375023:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532523648 00000100:00100000:0.0:1790919140.375094:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 173 00000100:00100000:0.0:1790919140.375105:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+35:11490:x1877914532523648:12345-192.168.201.27@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790919140.375160:0:5847:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790919140.375273:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+35:11490:x1877914532523648:12345-192.168.201.27@tcp:53:lhsmtool_posix.0 Request processed in 170us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919140.375281:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 173 00000100:00100000:2.0:1790919140.381859:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919140.381926:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532523904 00000100:00100000:0.0:1790919140.381937:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532523904 00000100:00100000:0.0:1790919140.382007:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 174 00000100:00100000:0.0:1790919140.382019:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf753b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+35:11490:x1877914532523904:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790919140.382039:0:8231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919140.382043:0:8231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790919140.382081:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4df1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce4a expref: 35 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.382110:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88be85efcd00) 00010000:00010000:0.0:1790919140.382115:0:8231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790919140.382128:0:8231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c4e45 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672ce5f expref: -99 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790919140.383051:0:8231:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1790919140.383301:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c4e4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.383561:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c4e4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.383575:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c4e4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.383694:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c4e45 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce5f expref: 37 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.383712:0:8231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c4e4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce5f expref: 36 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.383720:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88be853b5e00) 00010000:00010000:2.0:1790919140.383723:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790919140.383726:0:8231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac58200, rc 0) 00000100:00100000:2.0:1790919140.383801:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf753b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+36:11490:x1877914532523904:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 1783us (1951us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1790919140.383868:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 174 00000100:00100000:1.0:1790919140.387984:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919140.388052:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532524160 00000100:00100000:0.0:1790919140.388063:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532524160 00000100:00100000:0.0:1790919140.388155:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 175 00000100:00100000:0.0:1790919140.388163:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+36:11490:x1877914532524160:12345-192.168.201.27@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790919140.388211:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919140.388233:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c4e4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce5f expref: 36 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.388246:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88be853b5e00) 00010000:00010000:0.0:1790919140.388253:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790919140.388270:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4e5a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.388279:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4e5a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.388285:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4e5a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.388294:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c4e61 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x2148ee45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.388298:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c4e61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x2148ee45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.388302:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c4e61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x2148ee45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.388562:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4e5a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.388577:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4e5a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.388584:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4e5a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.388590:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac59a00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919140.388593:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4e5a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.388601:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4e5a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.388610:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88be85efcd00) 00010000:00010000:0.0:1790919140.388613:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919140.388617:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4e5a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.388622:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c4e5a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.388630:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c4e61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x2148ee45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.388636:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c4e61 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x2148ee45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.388642:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c4e61 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x2148ee45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.388647:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac59400 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919140.388656:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c4e61 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x2148ee45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.388663:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c4e61 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x2148ee45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.388671:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x2148ee45 (ffff88be853b5c00) 00010000:00010000:0.0:1790919140.388673:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919140.388676:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c4e61 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x2148ee45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.388682:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c4e61 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x2148ee45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919140.389716:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+35:11490:x1877914532524160:12345-192.168.201.27@tcp:36:lhsmtool_posix.0 Request processed in 1545us (1741us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790919140.389735:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 175 00000100:00100000:1.0:1790919140.393886:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919140.394018:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532524288 00000100:00100000:3.0:1790919140.394028:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532524288 00000100:00100000:3.0:1790919140.394198:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 176 00000100:00100000:3.0:1790919140.394210:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+35:11490:x1877914532524288:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790919140.394231:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919140.394255:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4e68 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672ce66 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.394288:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4e6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.394301:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4e6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.394311:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4e6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.394482:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4e68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce66 expref: 37 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.394508:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4e6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce66 expref: 36 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.394517:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88be88e22100) 00010000:00010000:3.0:1790919140.394520:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790919140.394523:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81673200, rc 0) 00000100:00100000:3.0:1790919140.394714:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+36:11490:x1877914532524288:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 506us (1411us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919140.394730:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 176 00000100:00100000:2.0:1790919140.402697:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919140.402937:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532524544 00000100:00100000:3.0:1790919140.402948:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532524544 00000100:00100000:3.0:1790919140.403056:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 177 00000100:00100000:3.0:1790919140.403067:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf750000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+36:11490:x1877914532524544:12345-192.168.201.27@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790919140.403169:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4e76 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.403187:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4e76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.403198:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4e76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790919140.403482:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1790919140.403493:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 342291965871ns, next at 343291963569ns, rc = 0 00000004:00010000:3.0:1790919140.403604:0:5845:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008a4f5e03 reply state 000000003996b377 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4e76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919140.403633:0:5845:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790919140.403877:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf750000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+38:11490:x1877914532524544:12345-192.168.201.27@tcp:36:lhsmtool_posix.0 Request processed in 811us (1187us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1790919140.403885:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 177 00000100:00100000:1.0:1790919140.406879:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919140.407313:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532524672 00000100:00100000:2.0:1790919140.407326:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532524672 00000100:00100000:2.0:1790919140.407390:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 178 00000100:00100000:2.0:1790919140.407400:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+38:11490:x1877914532524672:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790919140.407425:0:8231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919140.407444:0:8231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e600/0xc3296956897c4e7d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672ce6d expref: -99 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.407506:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e600/0xc3296956897c4e7d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce6d expref: 39 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.407521:0:8231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e600/0xc3296956897c4e7d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce6d expref: 39 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.407563:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88be88e22100) 00010000:00010000:2.0:1790919140.407566:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790919140.407569:0:8231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be90f9e600, rc 0) 00000100:00100000:2.0:1790919140.407622:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+39:11490:x1877914532524672:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 223us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919140.407630:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 178 00010000:00010000:3.0:1790919140.409678:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4e76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.409695:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4e76 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.409703:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4e76 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.409709:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81673800 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919140.409714:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4e76 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.409840:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4e76 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.409860:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88be88e22100) 00010000:00010000:3.0:1790919140.409863:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790919140.409868:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4e76 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.409874:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4e76 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919140.410148:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919140.410218:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532524800 00000100:00100000:3.0:1790919140.410226:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532524800 00000100:00100000:3.0:1790919140.410290:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 51 00000100:00100000:3.0:1790919140.410299:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba217100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+6:2353:x1877914532524800:12345-192.168.201.27@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1790919140.410681:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba217100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:2353:x1877914532524800:12345-192.168.201.27@tcp:2:lhsmtool_posix.0 Request processed in 381us (537us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1790919140.410689:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 51 00000100:00100000:0.0:1790919140.413007:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919140.413111:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532525056 00000100:00100000:1.0:1790919140.413136:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532525056 00000100:00100000:1.0:1790919140.413195:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 49 00000100:00100000:1.0:1790919140.413206:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba217b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+38:11490:x1877914532525056:12345-192.168.201.27@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790919140.413442:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba217b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+39:11490:x1877914532525056:12345-192.168.201.27@tcp:35:lhsmtool_posix.0 Request processed in 237us (444us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1790919140.413450:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 49 00000100:00100000:3.0:1790919140.415937:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919140.416019:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532525312 00000100:00100000:1.0:1790919140.416029:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532525312 00000100:00100000:1.0:1790919140.416097:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 179 00000100:00100000:1.0:1790919140.416108:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+39:11490:x1877914532525312:12345-192.168.201.27@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790919140.416219:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+39:11490:x1877914532525312:12345-192.168.201.27@tcp:57:lhsmtool_posix.0 Request processed in 112us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919140.416225:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 179 00000100:00100000:0.0:1790919140.418880:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919140.419441:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532525440 00000100:00100000:2.0:1790919140.419452:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532525440 00000100:00100000:2.0:1790919140.419509:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 180 00000100:00100000:2.0:1790919140.419519:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba214380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+39:11490:x1877914532525440:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790919140.419576:0:8231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919140.419601:0:8231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e200/0xc3296956897c4e84 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672ce74 expref: -99 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.419682:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e000/0xc3296956897c4e8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.420199:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e000/0xc3296956897c4e8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.420215:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e000/0xc3296956897c4e8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919140.420254:0:8231:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790919140.420274:0:8231:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e000/0xc3296956897c4e8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.420300:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e200/0xc3296956897c4e84 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce74 expref: 41 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.420317:0:8231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e000/0xc3296956897c4e8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce74 expref: 40 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.420326:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88be88e22100) 00010000:00010000:2.0:1790919140.420329:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790919140.420332:0:8231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be90f9e000, rc 0) 00000100:00100000:2.0:1790919140.420397:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba214380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+40:11490:x1877914532525440:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 878us (1524us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919140.420405:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 180 00000100:00100000:1.0:1790919140.435024:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919140.436589:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532525568 00000100:00100000:1.0:1790919140.436602:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532525568 00000100:00100000:1.0:1790919140.436657:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 52 00000100:00100000:1.0:1790919140.436667:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf733800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:2352:x1877914532525568:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790919140.436684:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919140.436702:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb214fb2/0xc3296956897c4e92 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672ce7b expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790919140.436737:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abf41e5, blocks: 0x1 00010000:00010000:1.0:1790919140.436758:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=342s v=(0 0) 00010000:00010000:1.0:1790919140.436763:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919140.436772:0:6698:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb214fb2/0xc3296956897c4e92 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce7b expref: 8 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919140.436798:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eb214fb2/0xc3296956897c4e92 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce7b expref: 8 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919140.436812:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88beb3f7ec00, rc 0) 00000100:00100000:1.0:1790919140.436876:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf733800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+8:2352:x1877914532525568:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 209us (1864us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919140.436883:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 52 00000100:00100000:2.0:1790919140.448066:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919140.448248:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532525824 00000100:00100000:1.0:1790919140.448259:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532525824 00000100:00100000:1.0:1790919140.448320:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 181 00000100:00100000:1.0:1790919140.448332:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf752680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+40:11490:x1877914532525824:12345-192.168.201.27@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790919140.448433:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf752680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+40:11490:x1877914532525824:12345-192.168.201.27@tcp:57:lhsmtool_posix.0 Request processed in 103us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919140.448440:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 181 00000100:00100000:0.0:1790919140.451287:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919140.451370:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532525952 00000100:00100000:3.0:1790919140.451380:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532525952 00000100:00100000:3.0:1790919140.451438:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 53 00000100:00100000:3.0:1790919140.451448:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba216a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+8:11490:x1877914532525952:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790919140.451467:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919140.451486:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fc75f30/0xc3296956897c4e99 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672ce82 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.451517:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb214fb2/0xc3296956897c4e92 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce7b expref: 9 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.451572:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919140.451576:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919140.451582:0:6699:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fc75f30/0xc3296956897c4e99 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce82 expref: 9 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.451617:0:6699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eb214fb2/0xc3296956897c4e92 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce7b expref: 9 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.451631:0:6699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eb214fb2/0xc3296956897c4e92 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce7b expref: 9 pid: 6698 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919140.451662:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b16680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6699:1877914550347648:192.168.201.27@tcp:104: 00000100:00100000:3.0:1790919140.451763:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be81377c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790919140.454516:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b16680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6699:1877914550347648:192.168.201.27@tcp:104: 00010000:00010000:3.0:1790919140.454631:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fc75f30/0xc3296956897c4e99 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce82 expref: 9 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.454652:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81673800, rc 0) 00000100:00100000:3.0:1790919140.454702:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba216a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+9:11490:x1877914532525952:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 3255us (3423us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919140.454711:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 53 00000100:00100000:2.0:1790919140.460185:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919140.463960:0:8529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532526080 00000100:00100000:3.0:1790919140.463987:0:8529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532526080 00010000:00010000:3.0:1790919140.464041:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eb214fb2/0xc3296956897c4e92 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce7b expref: 9 pid: 6698 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919140.464500:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 68 00000100:00100000:3.0:1790919140.464512:0:8529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be91cafc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+9:2352:x1877914532526080:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919140.464553:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919140.464580:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eb214fb2/0xc3296956897c4e92 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce7b expref: 9 pid: 6698 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.464595:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eb214fb2/0xc3296956897c4e92 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce7b expref: 9 pid: 6698 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.464638:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb214fb2/0xc3296956897c4e92 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce7b expref: 9 pid: 6698 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.464657:0:8529:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919140.464661:0:8529:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919140.464669:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001fc75f30/0xc3296956897c4e99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce82 expref: 8 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.464680:0:8529:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fc75f30/0xc3296956897c4e99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce82 expref: 8 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.464735:0:8529:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001fc75f30/0xc3296956897c4e99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce82 expref: 8 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919140.464750:0:8529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b16680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8529:1877914550347776:192.168.201.27@tcp:105: 00000100:00100000:3.0:1790919140.464838:0:8529:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be81377c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790919140.470406:0:8529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b16680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8529:1877914550347776:192.168.201.27@tcp:105: 00010000:00010000:2.0:1790919140.470448:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919140.470513:0:8529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be91cafc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+8:2352:x1877914532526080:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 6003us (10336us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919140.470543:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 68 00000100:00100000:0.0:1790919140.475365:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919140.475477:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532526208 00000100:00100000:1.0:1790919140.475488:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532526208 00002000:00100000:1.0:1790919140.475565:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff88beba214e00 x1877914532526208/t0(0) o4->c4a4e085-55d7-40e9-993c-11b4dfc2d5f5@192.168.201.27@tcp:261/0 lens 504/0 e 0 to 0 dl 1790919151 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790919140.475577:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88beba214e00 with x1877914532526208 ext(0->8) 00002000:00010000:1.0:1790919140.475583:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88beba214e00 00000100:00100000:1.0:1790919140.475614:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 4 00000100:00100000:1.0:1790919140.475624:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba214e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+8:2353:x1877914532526208:12345-192.168.201.27@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1790919140.476169:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba214e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+10:2353:x1877914532526208:12345-192.168.201.27@tcp:4:lhsmtool_posix.0 Request processed in 469us (736us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1790919140.476185:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 4 00002000:00100000:1.0:1790919140.476193:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff88beba214e00 x1877914532526208/t4294967314(0) o4->c4a4e085-55d7-40e9-993c-11b4dfc2d5f5@192.168.201.27@tcp:261/0 lens 504/448 e 0 to 0 dl 1790919151 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790919140.476200:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88beba214e00 with x1877914532526208 ext(0->8) 00002000:00010000:1.0:1790919140.476204:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88beba214e00 00000100:00100000:0.0:1790919140.482688:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919140.482842:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532526336 00000100:00100000:3.0:1790919140.482852:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532526336 00000100:00100000:3.0:1790919140.482905:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 182 00000100:00100000:3.0:1790919140.482915:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba214a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+40:11490:x1877914532526336:12345-192.168.201.27@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1790919140.548480:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba214a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+40:11490:x1877914532526336:12345-192.168.201.27@tcp:44:lhsmtool_posix.0 Request processed in 65556us (65794us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919140.548494:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 182 00000001:00080000:0.0:1790919140.548557:0:5869:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000001:00080000:0.0:1790919140.548586:0:5869:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:0.0:1790919140.548597:0:5869:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000004:00080000:0.0:1790919140.548632:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:0.0:1790919140.550513:0:5880:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1790919140.550552:0:5880:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1790919140.550699:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790919140.550839:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beba215500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550347904:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1790919140.550905:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919140.551391:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919140.556813:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550347904 00000100:00100000:1.0:1790919140.556829:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550347904 00000100:00100000:2.0:1790919140.559421:0:10350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532526464 00000100:00100000:2.0:1790919140.559436:0:10350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532526464 00000100:00100000:2.0:1790919140.559506:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790919140.559519:0:10350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba214700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550347904:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1790919140.559823:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 55 00000100:00100000:3.0:1790919140.559833:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd827f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+10:2352:x1877914532526464:12345-192.168.201.27@tcp:16:lhsmtool_posix.0 00000100:00080000:1.0:1790919140.559944:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1790919140.564368:0:10350:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1790919140.564377:0:10350:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1790919141 00002000:00010000:2.0:1790919140.564380:0:10350:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1790919140.564382:0:10350:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1790919141 -> 1790919141 00002000:00010000:2.0:1790919140.564385:0:10350:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1790919140.564469:0:10350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba214700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1877914550347904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 4950us (13560us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1790919140.564480:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:1.0:1790919140.564593:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88beba215500/2, rc 0, transno 4294967315 00000100:00100000:1.0:1790919140.564602:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beba215500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550347904:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1790919140.608408:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd827f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877914550348160:0@lo:400:kworker.0 00000100:00100000:0.0:1790919140.608479:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919140.608550:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1790919140.608557:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd827f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3308:1877914550348032:0@lo:400:kworker.0 00000100:00100000:0.0:1790919140.608587:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919140.608609:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd827f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550348544:0@lo:400:kworker.0 00000100:00100000:0.0:1790919140.608633:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919140.608720:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550348032 00000100:00100000:3.0:1790919140.608735:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550348032 00000100:00100000:3.0:1790919140.608785:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1790919140.608795:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87166c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3308:x1877914550348032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919140.608858:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87166c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3308:x1877914550348032:12345-0@lo:400:kworker.0 Request processed in 64us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919140.608866:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1790919140.608913:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd827f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3308:1877914550348032:0@lo:400:kworker.0 00000100:00100000:0.0:1790919140.609958:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd827f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1877914550348288:0@lo:400:kworker.0 00000100:00100000:0.0:1790919140.610026:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919140.610067:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790919140.610073:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd827f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1877914550348416:0@lo:400:kworker.0 00000100:00100000:0.0:1790919140.610175:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919140.610205:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550348160 00000100:00100000:0.0:1790919140.610211:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550348160 00000100:00100000:0.0:1790919140.610244:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550348288 00000100:00100000:0.0:1790919140.610248:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550348288 00000100:00100000:0.0:1790919140.610269:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550348416 00000100:00100000:0.0:1790919140.610272:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550348416 00000100:00100000:0.0:1790919140.610290:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1790919140.610297:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd827f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877914550348160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919140.610343:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd827f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877914550348160:12345-0@lo:400:kworker.0 Request processed in 46us (1863us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919140.610350:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1790919140.610367:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1790919140.610382:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd827f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877914550348288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919140.610416:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd827f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877914550348288:12345-0@lo:400:kworker.0 Request processed in 36us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919140.610422:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1790919140.610434:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1790919140.610440:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd827f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877914550348416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919140.610466:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd827f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877914550348416:12345-0@lo:400:kworker.0 Request processed in 26us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919140.610471:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1790919140.610508:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd827f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1877914550348416:0@lo:400:kworker.0 00000100:00100000:0.0:1790919140.610519:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd827f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1877914550348288:0@lo:400:kworker.0 00000100:00100000:3.0:1790919140.610675:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd827f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877914550348160:0@lo:400:kworker.0 00000100:00080000:1.0:1790919140.611251:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790919140.611268:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550348544 00000100:00100000:1.0:1790919140.611273:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550348544 00000100:00100000:1.0:1790919140.611323:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1790919140.611331:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd827f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3308:x1877914550348544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919140.611388:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd827f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3308:x1877914550348544:12345-0@lo:400:kworker.0 Request processed in 57us (2752us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919140.611394:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00010000:2.0:1790919140.611496:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790919140.611565:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790919140.611868:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd827f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550348544:0@lo:400:kworker.0 00000100:00100000:3.0:1790919140.656922:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd827f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+10:2352:x1877914532526464:12345-192.168.201.27@tcp:16:lhsmtool_posix.0 Request processed in 97082us (105523us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919140.656937:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 55 00000001:00080000:1.0:1790919140.658283:0:6722:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:1.0:1790919140.658303:0:6722:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:0.0:1790919140.666893:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919140.668067:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532526720 00000100:00100000:1.0:1790919140.668082:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532526720 00000100:00100000:0.0:1790919140.669447:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 183 00000100:00100000:0.0:1790919140.669461:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd827f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+18:11490:x1877914532526720:12345-192.168.201.27@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790919140.669521:0:8231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919140.675703:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e000/0xc3296956897c4e8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce74 expref: 18 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.675735:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88be88e22100) 00010000:00010000:0.0:1790919140.675740:0:8231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790919140.675782:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c4ea0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.675798:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c4ea0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.675818:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c4ea0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790919140.676107:0:8231:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005791ae4a reply state 000000000563bb1a transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c4ea0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919140.676117:0:8231:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790919140.676244:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd827f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+19:11490:x1877914532526720:12345-192.168.201.27@tcp:36:lhsmtool_posix.0 Request processed in 6785us (9360us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1790919140.676252:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 183 00000100:00100000:2.0:1790919140.681474:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919140.681586:0:10350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532526848 00000100:00100000:0.0:1790919140.681597:0:10350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532526848 00000100:00100000:0.0:1790919140.681651:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 56 00000100:00100000:0.0:1790919140.681660:0:10350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf752d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:2352:x1877914532526848:12345-192.168.201.27@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1790919140.681931:0:10350:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1790919140.681935:0:10350:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1790919141 -> 1790919140 00002000:00010000:0.0:1790919140.681937:0:10350:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1790919139 00002000:00010000:0.0:1790919140.681939:0:10350:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1790919141 -> 1790919140 00002000:00010000:0.0:1790919140.681941:0:10350:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1790919140.682012:0:10350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf752d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+8:2352:x1877914532526848:12345-192.168.201.27@tcp:2:lhsmtool_posix.0 Request processed in 351us (546us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1790919140.682019:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 56 00010000:00010000:3.0:1790919140.686843:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c4ea0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.686860:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c4ea0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.686868:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c4ea0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.686874:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac58200 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919140.686879:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c4ea0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.686887:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c4ea0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.686904:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88be88e22100) 00010000:00010000:3.0:1790919140.686907:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919140.686930:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c4ea0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.686936:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c4ea0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919140.687271:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919140.687386:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532527104 00000100:00100000:3.0:1790919140.687396:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532527104 00000100:00100000:3.0:1790919140.687451:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 184 00000100:00100000:3.0:1790919140.687461:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf750700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+18:11490:x1877914532527104:12345-192.168.201.27@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1790919140.687561:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4ea7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.687577:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4e6f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce66 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.687586:0:5845:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4ea7 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.687623:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4e6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce66 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.687637:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4e6f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce66 expref: 18 pid: 5846 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919140.687651:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b16a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1877914550348672:192.168.201.27@tcp:104: 00000100:00100000:3.0:1790919140.687742:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be927eb180 going to sleep for 11 seconds 00000100:00100000:3.0:1790919140.689905:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b16a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1877914550348672:192.168.201.27@tcp:104: 00010000:00010000:3.0:1790919140.689933:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4ea7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919140.691177:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919140.691293:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532527232 00000100:00100000:1.0:1790919140.691301:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532527232 00010000:00010000:1.0:1790919140.691341:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4e6f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce66 expref: 19 pid: 5846 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919140.691398:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 69 00000100:00100000:1.0:1790919140.691408:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf750e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+19:2353:x1877914532527232:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790919140.691423:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919140.691429:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4e6f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce66 expref: 19 pid: 5846 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919140.691441:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4e6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce66 expref: 19 pid: 5846 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919140.691464:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4e6f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce66 expref: 19 pid: 5846 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919140.691482:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88be88e22100) 00010000:00010000:1.0:1790919140.691488:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4ea7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919140.691497:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4ea7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919140.691504:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4ea7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919140.691561:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919140.691610:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf750e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+18:2353:x1877914532527232:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 202us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919140.691617:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 69 00010000:00010000:2.0:1790919140.691729:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4ea7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.691737:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4ea7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.691765:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4ea7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.691778:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4ea7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.691785:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4ea7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.691791:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81672c00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919140.691795:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4ea7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.691803:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4ea7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.691812:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88be88e22100) 00010000:00010000:2.0:1790919140.691815:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1790919140.691819:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4ea7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.691825:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4ea7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919140.691868:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf750700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+17:11490:x1877914532527104:12345-192.168.201.27@tcp:55:lhsmtool_posix.0 Request processed in 4408us (4602us total) trans 0 rc -22/-22 00000100:00100000:2.0:1790919140.691876:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 184 00000100:00100000:2.0:1790919140.694381:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919140.694454:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532527360 00000100:00100000:1.0:1790919140.694477:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532527360 00000100:00100000:1.0:1790919140.694553:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 57 00000100:00100000:1.0:1790919140.694563:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba03e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+8:2352:x1877914532527360:12345-192.168.201.27@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1790919140.694608:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000007899b5/0xc3296956897c4eae lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919140.694629:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001fc75f30/0xc3296956897c4e99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce82 expref: 8 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919140.694637:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919140.694642:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790919140.694647:0:6699:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000007899b5/0xc3296956897c4eae lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919140.694679:0:6699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001fc75f30/0xc3296956897c4e99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce82 expref: 8 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919140.694693:0:6699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001fc75f30/0xc3296956897c4e99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce82 expref: 8 pid: 6699 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919140.694708:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf732680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6699:1877914550348800:192.168.201.27@tcp:104: 00000100:00100000:1.0:1790919140.694794:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be91c84480 going to sleep for 11 seconds 00000100:00100000:2.0:1790919140.698086:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919140.698156:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532527488 00000100:00100000:0.0:1790919140.698166:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532527488 00010000:00010000:0.0:1790919140.698208:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001fc75f30/0xc3296956897c4e99 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce82 expref: 9 pid: 6699 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919140.698277:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 70 00000100:00100000:0.0:1790919140.698288:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+9:2352:x1877914532527488:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790919140.698305:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919140.698330:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001fc75f30/0xc3296956897c4e99 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce82 expref: 9 pid: 6699 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.698344:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001fc75f30/0xc3296956897c4e99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce82 expref: 9 pid: 6699 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.698369:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790919140.698374:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790919140.698380:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000007899b5/0xc3296956897c4eae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.698390:0:5831:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000007899b5/0xc3296956897c4eae lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.698409:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919140.698462:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+9:2352:x1877914532527488:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 176us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919140.698470:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 70 00010000:00010000:3.0:1790919140.698925:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fc75f30/0xc3296956897c4e99 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce82 expref: 8 pid: 6699 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919140.698942:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf732680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6699:1877914550348800:192.168.201.27@tcp:104: 00010000:00010000:3.0:1790919140.698961:0:6699:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000007899b5/0xc3296956897c4eae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.698980:0:6699:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000007899b5/0xc3296956897c4eae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.698986:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000007899b5/0xc3296956897c4eae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.699012:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000007899b5/0xc3296956897c4eae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.699020:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000007899b5/0xc3296956897c4eae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.699028:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000007899b5/0xc3296956897c4eae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.699035:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88beb3f7e800 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:3.0:1790919140.699039:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000007899b5/0xc3296956897c4eae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.699074:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000007899b5/0xc3296956897c4eae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.699087:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000007899b5/0xc3296956897c4eae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.699094:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000007899b5/0xc3296956897c4eae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919140.699161:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba03e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:2352:x1877914532527360:12345-192.168.201.27@tcp:1:lhsmtool_posix.0 Request processed in 4599us (4788us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919140.699169:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 57 00000100:00100000:2.0:1790919140.703364:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919140.703502:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532527744 00000100:00100000:0.0:1790919140.703512:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532527744 00000100:00100000:0.0:1790919140.703601:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 185 00000100:00100000:0.0:1790919140.703612:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be83438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+17:11490:x1877914532527744:12345-192.168.201.27@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790919140.703709:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58600/0xc3296956897c4eb5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.703740:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58600/0xc3296956897c4eb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.703752:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58600/0xc3296956897c4eb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.703988:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c4ebc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.703999:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e600/0xc3296956897c4e7d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce6d expref: 18 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.704008:0:5846:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c4ebc lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.704043:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e600/0xc3296956897c4e7d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce6d expref: 18 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919140.704068:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e600/0xc3296956897c4e7d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce6d expref: 18 pid: 8231 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919140.704298:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd827f2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877914550348928:192.168.201.27@tcp:104: 00000100:00100000:0.0:1790919140.704383:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be814c2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790919140.707119:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919140.707194:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532527872 00000100:00100000:1.0:1790919140.707203:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532527872 00010000:00010000:1.0:1790919140.707244:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e600/0xc3296956897c4e7d lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce6d expref: 19 pid: 8231 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919140.707301:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 71 00000100:00100000:1.0:1790919140.707310:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd827f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+19:2353:x1877914532527872:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790919140.707326:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919140.707334:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e600/0xc3296956897c4e7d lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce6d expref: 19 pid: 8231 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919140.707346:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e600/0xc3296956897c4e7d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce6d expref: 19 pid: 8231 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919140.707367:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88be88e22100) 00010000:00010000:1.0:1790919140.707373:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c4ebc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919140.707383:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c4ebc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919140.707389:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c4ebc lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919140.707408:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919140.707467:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd827f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+19:2353:x1877914532527872:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 157us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919140.707474:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 71 00010000:00010000:2.0:1790919140.707923:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e600/0xc3296956897c4e7d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce6d expref: 18 pid: 8231 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919140.707952:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd827f2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877914550348928:192.168.201.27@tcp:104: 00010000:00010000:2.0:1790919140.707983:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c4ebc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.707992:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c4ebc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.707998:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c4ebc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790919140.708154:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:2.0:1790919140.708294:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1790919140.708343:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:2.0:1790919140.708428:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be83439f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1877914550349056:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1790919140.708490:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919140.709019:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550349056 00000100:00100000:0.0:1790919140.709026:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550349056 00000100:00100000:0.0:1790919140.709077:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790919140.709102:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba14f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1877914550349056:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1790919140.709172:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba14f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1877914550349056:12345-0@lo:1000:mdt00_001.0 Request processed in 73us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919140.709179:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790919140.710069:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bec21489c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790919140.710105:0:5846:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1790919140.710112:0:5846:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88beba215500, transno 4294967315 00000100:00100000:2.0:1790919140.710131:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be83439f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1877914550349056:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1790919140.711348:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1790919140.711428:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beba14fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1877914550349184:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1790919140.711497:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919140.711812:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550349184 00000100:00100000:0.0:1790919140.711819:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550349184 00000100:00100000:0.0:1790919140.711872:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790919140.711882:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba14c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1877914550349184:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1790919140.712106:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba14c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5846:x1877914550349184:12345-0@lo:1000:mdt00_001.0 Request processed in 224us (607us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1790919140.712113:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790919140.712316:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be88cb4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790919140.712346:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beba14fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1877914550349184:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1790919140.712383:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c4ebc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.712404:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c4ebc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.712412:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c4ebc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.712418:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac59800 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919140.712422:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c4ebc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.712430:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c4ebc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.712445:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88be88e22100) 00010000:00010000:2.0:1790919140.712449:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790919140.712453:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c4ebc lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.712459:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c4ebc lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.712489:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4df8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.712496:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4df8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.712502:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4df8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.712507:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac59000 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919140.712516:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4df8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.712523:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4df8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.712563:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be853b5800) 00010000:00010000:2.0:1790919140.712565:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790919140.712569:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4df8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.712574:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4df8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.712595:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c4ec3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.712609:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4e14 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce51 expref: 21 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.712618:0:5846:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c4ec3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.712645:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4e14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce51 expref: 21 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.712659:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4e14 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce51 expref: 21 pid: 5847 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919140.712671:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beba14ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877914550349312:192.168.201.27@tcp:104: 00000100:00100000:2.0:1790919140.712878:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be838f8240 going to sleep for 11 seconds 00000100:00100000:0.0:1790919140.716892:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919140.717025:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532528000 00000100:00100000:1.0:1790919140.717037:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532528000 00010000:00010000:1.0:1790919140.717096:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4e14 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce51 expref: 22 pid: 5847 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919140.717154:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 72 00000100:00100000:1.0:1790919140.717164:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd827f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+22:2352:x1877914532528000:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790919140.717178:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919140.717185:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4e14 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce51 expref: 22 pid: 5847 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919140.717196:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4e14 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce51 expref: 22 pid: 5847 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919140.717217:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be853b5800) 00010000:00010000:1.0:1790919140.717222:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c4ec3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919140.717231:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c4ec3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919140.717239:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c4ec3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919140.717255:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919140.717309:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd827f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+22:2352:x1877914532528000:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 145us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919140.717317:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 72 00010000:00010000:2.0:1790919140.718688:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4e14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce51 expref: 21 pid: 5847 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919140.718709:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beba14ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877914550349312:192.168.201.27@tcp:104: 00010000:00010000:2.0:1790919140.718742:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c4ec3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.718752:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c4ec3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.718757:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c4ec3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.718769:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c4ec3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.718776:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c4ec3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.718782:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c4ec3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.718787:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be90f9f600 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919140.718791:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c4ec3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.718798:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c4ec3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.718810:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be853b5800) 00010000:00010000:2.0:1790919140.718813:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919140.718830:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c4ec3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.718837:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c4ec3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.718848:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58600/0xc3296956897c4eb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.718854:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58600/0xc3296956897c4eb5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.718860:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58600/0xc3296956897c4eb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.718865:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac58600 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919140.718868:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58600/0xc3296956897c4eb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.718874:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58600/0xc3296956897c4eb5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.718881:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be853b5800) 00010000:00010000:2.0:1790919140.718884:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790919140.718886:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58600/0xc3296956897c4eb5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919140.718893:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58600/0xc3296956897c4eb5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919140.719451:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be83438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+20:11490:x1877914532527744:12345-192.168.201.27@tcp:57:lhsmtool_posix.0 Request processed in 15839us (16094us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1790919140.719461:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 185 00000020:00080000:2.0:1790919140.719474:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1790919140.719648:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790919140.719652:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790919140.720150:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1790919140.720158:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790919140.723875:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919140.723981:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532528256 00000100:00100000:1.0:1790919140.723992:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532528256 00000100:00100000:3.0:1790919140.724203:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 50 00000100:00100000:3.0:1790919140.724216:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9290bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+20:11490:x1877914532528256:12345-192.168.201.27@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1790919140.725876:0:5848:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1790919140.726005:0:5848:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1790919140.726999:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4eca lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.727018:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4eca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.727030:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4eca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.727039:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4eca lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.727055:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4eca lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.727062:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4eca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919140.727097:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790919140.727222:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9290bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+22:11490:x1877914532528256:12345-192.168.201.27@tcp:35:lhsmtool_posix.0 Request processed in 3005us (3354us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1790919140.727231:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 50 00000020:00080000:3.0:1790919140.727237:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790919140.728203:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919140.728212:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4eca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919140.728227:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81673800 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:1.0:1790919140.728231:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4eca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919140.728240:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4eca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919140.728254:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88be88e22a00) 00010000:00010000:1.0:1790919140.728257:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790919140.728262:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4eca lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919140.728268:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4eca lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919140.728288:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919140.728290:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919140.728292:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790919140.865941:0:12530:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790919140.865951:0:12530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790919140.866001:0:12530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1790919140.866006:0:12530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790919141.010803:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919141.010937:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532528512 00000100:00100000:0.0:1790919141.010949:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532528512 00000100:00100000:0.0:1790919141.011023:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 186 00000100:00100000:0.0:1790919141.011034:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+22:11500:x1877914532528512:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:0.0:1790919141.011072:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919141.011098:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c4ed1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672ce89 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.011196:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58e00/0xc3296956897c4ed8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.011221:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58e00/0xc3296956897c4ed8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.011232:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58e00/0xc3296956897c4ed8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919141.011245:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1790919141.011372:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c4ed1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce89 expref: 25 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.011390:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58e00/0xc3296956897c4ed8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce89 expref: 24 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.011398:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88be85efcd00) 00010000:00010000:0.0:1790919141.011401:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790919141.011404:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac58e00, rc 0) 00000100:00100000:0.0:1790919141.011654:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+24:11500:x1877914532528512:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 620us (860us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1790919141.011663:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 186 00000100:00100000:0.0:1790919141.016711:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919141.016776:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532528640 00000100:00100000:2.0:1790919141.016785:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532528640 00000100:00100000:2.0:1790919141.016846:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 187 00000100:00100000:2.0:1790919141.016856:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd827f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+24:11500:x1877914532528640:12345-192.168.201.27@tcp:34:lfs.0 00010000:00010000:2.0:1790919141.016931:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c4ee6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.016949:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c4ee6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.016961:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c4ee6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.016987:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fe00/0xc3296956897c4eed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.016996:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fe00/0xc3296956897c4eed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.017003:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fe00/0xc3296956897c4eed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.017265:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e800/0xc3296956897c4ef4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.017274:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e800/0xc3296956897c4ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.017292:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e800/0xc3296956897c4ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790919141.017333:0:8231:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e800/0xc3296956897c4ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.017345:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c4ee6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.017351:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c4ee6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.017358:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c4ee6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.017363:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be90f9ee00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919141.017367:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c4ee6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.017374:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c4ee6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.017386:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88be85efcd00) 00010000:00010000:2.0:1790919141.017389:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919141.017393:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c4ee6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.017399:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c4ee6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.017411:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fe00/0xc3296956897c4eed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.017423:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fe00/0xc3296956897c4eed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.017428:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fe00/0xc3296956897c4eed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.017434:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be90f9fe00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919141.017437:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fe00/0xc3296956897c4eed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.017443:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fe00/0xc3296956897c4eed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.017452:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88be85efc900) 00010000:00010000:2.0:1790919141.017454:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919141.017456:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fe00/0xc3296956897c4eed lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.017462:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fe00/0xc3296956897c4eed lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.017476:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e800/0xc3296956897c4ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.017482:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e800/0xc3296956897c4ef4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.017486:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e800/0xc3296956897c4ef4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.017491:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be90f9e800 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919141.017499:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e800/0xc3296956897c4ef4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.017505:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e800/0xc3296956897c4ef4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.017513:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be85efc600) 00010000:00010000:2.0:1790919141.017515:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919141.017517:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e800/0xc3296956897c4ef4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.017686:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e800/0xc3296956897c4ef4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919141.017816:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd827f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+24:11500:x1877914532528640:12345-192.168.201.27@tcp:34:lfs.0 Request processed in 959us (1109us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919141.017826:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 187 00000100:00100000:1.0:1790919141.071429:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919141.071472:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532528896 00000100:00100000:1.0:1790919141.071482:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532528896 00000100:00100000:1.0:1790919141.071559:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 188 00000100:00100000:1.0:1790919141.071570:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+24:11503:x1877914532528896:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:1.0:1790919141.071591:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919141.071615:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7fc00/0xc3296956897c4efb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672ce90 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919141.071693:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f400/0xc3296956897c4f02 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919141.071732:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f400/0xc3296956897c4f02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919141.071744:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f400/0xc3296956897c4f02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919141.071760:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c4f09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919141.071768:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c4f09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919141.071775:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c4f09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919141.072062:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f800/0xc3296956897c4f10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919141.072072:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f800/0xc3296956897c4f10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919141.072080:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f800/0xc3296956897c4f10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790919141.072092:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1790919141.072191:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f400/0xc3296956897c4f02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919141.072200:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f400/0xc3296956897c4f02 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919141.072207:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f400/0xc3296956897c4f02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919141.072221:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88beb3f7f400 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:1.0:1790919141.072226:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f400/0xc3296956897c4f02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919141.072235:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f400/0xc3296956897c4f02 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919141.072248:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88be85efcd00) 00010000:00010000:1.0:1790919141.072252:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919141.072257:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f400/0xc3296956897c4f02 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919141.072264:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f400/0xc3296956897c4f02 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919141.072279:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c4f09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919141.072285:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c4f09 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919141.072290:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c4f09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919141.072294:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88beb3f7e200 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:1.0:1790919141.072297:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c4f09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919141.072303:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c4f09 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919141.072321:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88be8b621a00) 00010000:00010000:1.0:1790919141.072324:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919141.072327:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c4f09 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919141.072332:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c4f09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919141.072378:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7fc00/0xc3296956897c4efb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce90 expref: 27 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919141.072393:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f800/0xc3296956897c4f10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce90 expref: 26 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919141.072400:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be8b621600) 00010000:00010000:1.0:1790919141.072402:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790919141.072405:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88beb3f7f800, rc 0) 00000100:00100000:1.0:1790919141.072475:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+26:11503:x1877914532528896:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 907us (1055us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1790919141.072483:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 188 00000100:00100000:1.0:1790919141.081739:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919141.082014:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532529024 00000100:00100000:2.0:1790919141.082026:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532529024 00000100:00100000:2.0:1790919141.082087:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 189 00000100:00100000:2.0:1790919141.082096:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+26:11503:x1877914532529024:12345-192.168.201.27@tcp:54:lfs.0 00010000:00010000:2.0:1790919141.082164:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e800/0xc3296956897c4f1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.082181:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e800/0xc3296956897c4f1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.082193:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e800/0xc3296956897c4f1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.082223:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e800/0xc3296956897c4f1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.082238:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e800/0xc3296956897c4f1e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.082245:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e800/0xc3296956897c4f1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.082250:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be90f9e800 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919141.082255:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e800/0xc3296956897c4f1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.082262:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e800/0xc3296956897c4f1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.082273:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be8b621600) 00010000:00010000:2.0:1790919141.082276:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790919141.082281:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e800/0xc3296956897c4f1e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.082286:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e800/0xc3296956897c4f1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919141.082401:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+26:11503:x1877914532529024:12345-192.168.201.27@tcp:54:lfs.0 Request processed in 305us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919141.082410:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 189 00000100:00100000:0.0:1790919141.093051:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919141.093113:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532529280 00000100:00100000:1.0:1790919141.093123:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532529280 00000100:00100000:1.0:1790919141.093180:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 51 00000100:00100000:1.0:1790919141.093191:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd827f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+26:11503:x1877914532529280:12345-192.168.201.27@tcp:35:lfs.0 00000100:00100000:1.0:1790919141.093455:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd827f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+27:11503:x1877914532529280:12345-192.168.201.27@tcp:35:lfs.0 Request processed in 264us (408us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1790919141.093475:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 51 00000100:00100000:0.0:1790919141.145097:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790919141.145119:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd827f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550349440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790919141.145195:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919141.145258:0:11721:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550349440 00000100:00100000:0.0:1790919141.145266:0:11721:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550349440 00000100:00100000:0.0:1790919141.145315:0:11721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790919141.145326:0:11721:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb440dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1877914550349440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790919141.145371:0:11721:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790919141.145421:0:11721:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb440dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1877914550349440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919141.145429:0:11721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790919141.145672:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd827f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550349440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790919141.146337:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919141.146646:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532529536 00000100:00100000:3.0:1790919141.146653:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532529536 00000100:00100000:3.0:1790919141.146695:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 190 00000100:00100000:3.0:1790919141.146703:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+27:11037:x1877914532529536:12345-192.168.201.27@tcp:101:bash.0 00010000:00010000:3.0:1790919141.146734:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919141.146755:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c4f25 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672ce97 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919141.146848:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4f2c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919141.146864:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f800/0xc3296956897c4f10 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce90 expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919141.146873:0:5845:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4f2c lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919141.146918:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f800/0xc3296956897c4f10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce90 expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919141.146931:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f800/0xc3296956897c4f10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce90 expref: 28 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919141.146942:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b17480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1877914550349568:192.168.201.27@tcp:104: 00000100:00100000:3.0:1790919141.147027:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be81254cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919141.158912:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919141.159470:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b17480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1877914550349568:192.168.201.27@tcp:104: 00010000:00010000:3.0:1790919141.159497:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4f2c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919141.160684:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532529664 00000100:00100000:0.0:1790919141.160695:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532529664 00010000:00010000:0.0:1790919141.160736:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f800/0xc3296956897c4f10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce90 expref: 29 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919141.160778:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 73 00000100:00100000:0.0:1790919141.160788:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd827f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+29:2352:x1877914532529664:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790919141.160803:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919141.160809:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f800/0xc3296956897c4f10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce90 expref: 29 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.160821:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f800/0xc3296956897c4f10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce90 expref: 29 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.160842:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f800/0xc3296956897c4f10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce90 expref: 29 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.160860:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be8b621600) 00010000:00010000:0.0:1790919141.160864:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4f2c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.160886:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4f2c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.160893:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4f2c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.160919:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919141.160989:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd827f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+28:2352:x1877914532529664:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 201us (2084us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919141.160996:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 73 00010000:00010000:0.0:1790919141.161021:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4f2c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.161028:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4f2c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919141.161059:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1790919141.161202:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c4f25 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce97 expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.161218:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4f2c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce97 expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.161226:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be8b621600) 00010000:00010000:0.0:1790919141.161228:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790919141.161231:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81673800, rc 0) 00000100:00100000:0.0:1790919141.161258:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+28:11037:x1877914532529536:12345-192.168.201.27@tcp:101:bash.0 Request processed in 14557us (14924us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1790919141.161275:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 190 00000100:00100000:0.0:1790919141.172495:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919141.172551:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532529920 00000100:00100000:0.0:1790919141.172561:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532529920 00000100:00100000:0.0:1790919141.172613:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 191 00000100:00100000:0.0:1790919141.172623:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd827f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+28:11037:x1877914532529920:12345-192.168.201.27@tcp:36:bash.0 00010000:00010000:0.0:1790919141.172900:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c4f3a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.172918:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c4f3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.172930:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c4f3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790919141.172996:0:8231:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:0.0:1790919141.173022:0:8231:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006b1adb2f reply state 00000000b26151c7 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c4f3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919141.173031:0:8231:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1790919141.173079:0:8231:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:0.0:1790919141.173180:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd827f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+32:11037:x1877914532529920:12345-192.168.201.27@tcp:36:bash.0 Request processed in 557us (693us total) trans 4294967475 rc 0/0 00000100:00100000:0.0:1790919141.173189:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 191 00000020:00080000:0.0:1790919141.173194:0:8231:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1790919141.177237:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c4f3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.177254:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c4f3a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.177269:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c4f3a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.177276:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac58000 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919141.177280:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c4f3a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.177288:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c4f3a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.177302:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be8b621600) 00010000:00010000:0.0:1790919141.177305:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919141.177309:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c4f3a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.177316:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c4f3a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919141.184794:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919141.185797:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532530048 00000100:00100000:0.0:1790919141.185811:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532530048 00000100:00100000:0.0:1790919141.185862:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 192 00000100:00100000:0.0:1790919141.185873:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+31:11037:x1877914532530048:12345-192.168.201.27@tcp:101:bash.0 00010000:00010000:0.0:1790919141.185898:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919141.185918:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c4f41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672ce9e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.185991:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c4f41 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce9e expref: 32 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.186022:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c4f41 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce9e expref: 32 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.186045:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be8b621600) 00010000:00010000:0.0:1790919141.186048:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790919141.186051:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac58000, rc 0) 00000100:00100000:0.0:1790919141.186108:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+32:11037:x1877914532530048:12345-192.168.201.27@tcp:101:bash.0 Request processed in 236us (1325us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919141.186116:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 192 00000100:00100000:1.0:1790919141.189403:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919141.189488:0:10350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532530176 00000100:00100000:0.0:1790919141.189500:0:10350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532530176 00000100:00100000:0.0:1790919141.189602:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 58 00000100:00100000:0.0:1790919141.189611:0:10350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf730e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:11037:x1877914532530176:12345-192.168.201.27@tcp:101:bash.0 00010000:00010000:0.0:1790919141.189630:0:10350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919141.189651:0:10350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003122c64b/0xc3296956897c4f48 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cea5 expref: -99 pid: 10350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790919141.189677:0:10350:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6abf41e4, atime: 0x6abf41e3, ctime: 0x6abf41e4, blocks: 0xb 00010000:00010000:0.0:1790919141.189700:0:10350:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=343s v=(0 0) 00010000:00010000:0.0:1790919141.189705:0:10350:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00000100:00080000:1.0:1790919141.189832:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790919141.189922:0:10350:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003122c64b/0xc3296956897c4f48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cea5 expref: 8 pid: 10350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.189945:0:10350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003122c64b/0xc3296956897c4f48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cea5 expref: 8 pid: 10350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.189992:0:10350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac58600, rc 0) 00000100:00100000:0.0:1790919141.190056:0:10350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf730e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+8:11037:x1877914532530176:12345-192.168.201.27@tcp:101:bash.0 Request processed in 446us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919141.190064:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 58 00000100:00100000:0.0:1790919141.193199:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919141.193274:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532530304 00000100:00100000:1.0:1790919141.193283:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532530304 00002000:00010000:1.0:1790919141.193325:0:6705:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1790919141.193329:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88bd827f0000 with x1877914532530304 ext(0->18446744073709551615) 00002000:00010000:1.0:1790919141.193340:0:6705:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88bd827f0000. 00000100:00100000:1.0:1790919141.193372:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 5 00000100:00100000:1.0:1790919141.193382:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd827f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+8:2350:x1877914532530304:12345-192.168.201.27@tcp:10:bash.0 00002000:00010000:1.0:1790919141.193691:0:6705:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1790919141.193695:0:6705:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1790919140 -> 1790919141 00002000:00010000:1.0:1790919141.193697:0:6705:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1790919139 -> 1790919139 00002000:00010000:1.0:1790919141.193699:0:6705:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1790919140 -> 1790919141 00002000:00010000:1.0:1790919141.193701:0:6705:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1790919141.193861:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd827f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+9:2350:x1877914532530304:12345-192.168.201.27@tcp:10:bash.0 Request processed in 480us (670us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1790919141.193870:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 5 00002000:00010000:1.0:1790919141.193874:0:6705:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1790919141.193877:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88bd827f0000 with x1877914532530304 ext(0->18446744073709551615) 00002000:00010000:1.0:1790919141.193882:0:6705:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88bd827f0000. 00000100:00100000:1.0:1790919141.284480:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919141.284654:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532530432 00000100:00100000:0.0:1790919141.284665:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532530432 00000100:00100000:0.0:1790919141.284742:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 193 00000100:00100000:0.0:1790919141.284753:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf732680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+32:11517:x1877914532530432:12345-192.168.201.27@tcp:34:lfs.0 00010000:00010000:0.0:1790919141.284830:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4f4f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.284850:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4f4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.284861:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4f4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.284880:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4f56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.284886:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4f56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.284892:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4f56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.285338:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c4f5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.285354:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c4f5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.285361:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c4f5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790919141.285405:0:8231:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c4f5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.285416:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4f4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.285423:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4f4f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.285429:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4f4f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.285435:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac59e00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919141.285440:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4f4f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.285450:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4f4f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.285463:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88be85efcd00) 00010000:00010000:0.0:1790919141.285466:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919141.285471:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4f4f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.285477:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4f4f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.285496:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4f56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.285503:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4f56 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.285520:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4f56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.285793:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac59000 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919141.285797:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4f56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.285804:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4f56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.285813:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88be853b5800) 00010000:00010000:0.0:1790919141.285815:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919141.285818:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4f56 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.285823:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4f56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.285839:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c4f5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.285845:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c4f5d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.285850:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c4f5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.285862:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac59400 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919141.285866:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c4f5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.285874:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c4f5d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.285882:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be8b621600) 00010000:00010000:0.0:1790919141.285884:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919141.285887:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c4f5d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.285892:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c4f5d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919141.285979:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf732680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+32:11517:x1877914532530432:12345-192.168.201.27@tcp:34:lfs.0 Request processed in 1225us (1505us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919141.285988:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 193 00000100:00100000:2.0:1790919141.332096:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919141.332221:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532530688 00000100:00100000:0.0:1790919141.332232:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532530688 00000100:00100000:0.0:1790919141.332301:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 194 00000100:00100000:0.0:1790919141.332321:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba14ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+32:11520:x1877914532530688:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:0.0:1790919141.332344:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919141.332366:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c4f64 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672ceac expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.332439:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4f6b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.332474:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4f6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.332486:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4f6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.332501:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4f72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.332508:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4f72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.332514:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4f72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.332811:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c4f79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.332820:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c4f79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.332827:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c4f79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919141.332837:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1790919141.332929:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4f6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.332937:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4f6b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.332944:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4f6b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.332968:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac59000 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919141.332973:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4f6b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.332980:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4f6b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.332991:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88be85efcd00) 00010000:00010000:0.0:1790919141.332994:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919141.332999:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4f6b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.333004:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4f6b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.333016:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4f72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.333020:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4f72 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.333025:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4f72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.333030:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac59e00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919141.333033:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4f72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.333038:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4f72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.333055:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88be853b5800) 00010000:00010000:0.0:1790919141.333057:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919141.333061:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4f72 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.333066:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4f72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.333107:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c4f64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ceac expref: 35 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.333120:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c4f79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ceac expref: 34 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.333127:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be8b621600) 00010000:00010000:0.0:1790919141.333129:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1790919141.333131:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac58c00, rc 0) 00000100:00100000:0.0:1790919141.333201:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba14ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+34:11520:x1877914532530688:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 882us (1125us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1790919141.333209:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 194 00000100:00100000:1.0:1790919141.340660:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919141.340789:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532530816 00000100:00100000:2.0:1790919141.340800:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532530816 00000100:00100000:2.0:1790919141.340864:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 195 00000100:00100000:2.0:1790919141.340875:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+34:11520:x1877914532530816:12345-192.168.201.27@tcp:54:lfs.0 00010000:00010000:2.0:1790919141.340954:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fe00/0xc3296956897c4f87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.340983:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4f2c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce97 expref: 34 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.340992:0:5846:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fe00/0xc3296956897c4f87 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.341030:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4f2c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce97 expref: 34 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.341045:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4f2c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce97 expref: 34 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919141.341059:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beba14dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877914550349696:192.168.201.27@tcp:104: 00000100:00100000:2.0:1790919141.341184:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be838f8240 going to sleep for 11 seconds 00000100:00100000:2.0:1790919141.343481:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beba14dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877914550349696:192.168.201.27@tcp:104: 00010000:00010000:2.0:1790919141.343508:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fe00/0xc3296956897c4f87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919141.344795:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919141.345160:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532531072 00000100:00100000:2.0:1790919141.345170:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532531072 00000100:00100000:2.0:1790919141.345237:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 52 00000100:00100000:2.0:1790919141.345247:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be85f3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+35:5589:x1877914532531072:12345-192.168.201.27@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1790919141.345602:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be85f3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+36:5589:x1877914532531072:12345-192.168.201.27@tcp:35:ldlm_bl.0 Request processed in 355us (812us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1790919141.345629:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 52 00000100:00100000:1.0:1790919141.349917:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919141.350042:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532531200 00000100:00100000:0.0:1790919141.350062:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532531200 00010000:00010000:0.0:1790919141.350115:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4f2c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce97 expref: 36 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919141.350157:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 74 00000100:00100000:0.0:1790919141.350167:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be85f39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+36:2352:x1877914532531200:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790919141.350331:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919141.350338:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4f2c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce97 expref: 36 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.350352:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4f2c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce97 expref: 36 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.350375:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4f2c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce97 expref: 36 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.350394:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be8b621600) 00010000:00010000:0.0:1790919141.350399:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fe00/0xc3296956897c4f87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.350409:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fe00/0xc3296956897c4f87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.350418:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fe00/0xc3296956897c4f87 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.350446:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919141.350597:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be85f39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+35:2352:x1877914532531200:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 430us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919141.350606:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 74 00010000:00010000:2.0:1790919141.351077:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fe00/0xc3296956897c4f87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.351087:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fe00/0xc3296956897c4f87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.351117:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fe00/0xc3296956897c4f87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.351125:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fe00/0xc3296956897c4f87 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.351131:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fe00/0xc3296956897c4f87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.351137:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be90f9fe00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919141.351141:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fe00/0xc3296956897c4f87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.351148:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fe00/0xc3296956897c4f87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.351158:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be8b621600) 00010000:00010000:2.0:1790919141.351161:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790919141.351164:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fe00/0xc3296956897c4f87 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.351169:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fe00/0xc3296956897c4f87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919141.351225:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+34:11520:x1877914532530816:12345-192.168.201.27@tcp:54:lfs.0 Request processed in 10352us (10574us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919141.351240:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 195 00000100:00100000:1.0:1790919141.356382:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919141.356543:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532531456 00000100:00100000:2.0:1790919141.356553:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532531456 00000100:00100000:2.0:1790919141.356610:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 53 00000100:00100000:2.0:1790919141.356620:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be85f38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+34:11520:x1877914532531456:12345-192.168.201.27@tcp:35:lfs.0 00000100:00100000:2.0:1790919141.356878:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be85f38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+35:11520:x1877914532531456:12345-192.168.201.27@tcp:35:lfs.0 Request processed in 258us (503us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1790919141.356886:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 53 00000100:00100000:3.0:1790919141.451157:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919141.451369:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532531712 00000100:00100000:0.0:1790919141.451380:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532531712 00000100:00100000:0.0:1790919141.451444:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 196 00000100:00100000:0.0:1790919141.451465:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+35:11531:x1877914532531712:12345-192.168.201.27@tcp:101:cat.0 00010000:00010000:0.0:1790919141.451509:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919141.451560:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c4f8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672ceb3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.451635:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4f95 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.451650:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4f95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.451661:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4f95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.451676:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4f9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.451683:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4f9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.451691:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4f9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.451972:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c4fa3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.451983:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c4fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.451989:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c4fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919141.451999:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1790919141.452110:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4f95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.452118:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4f95 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.452124:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4f95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.452130:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac59e00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919141.452134:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4f95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.452142:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4f95 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.452153:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88be85efcd00) 00010000:00010000:0.0:1790919141.452155:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919141.452160:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4f95 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.452166:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c4f95 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.452478:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4f9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.452484:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4f9c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.452490:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4f9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.452495:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac59000 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919141.452505:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4f9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.452512:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4f9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.452520:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88be853b5800) 00010000:00010000:0.0:1790919141.452523:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919141.452567:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4f9c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.452574:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c4f9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.452620:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c4f8e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ceb3 expref: 38 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.452634:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c4fa3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ceb3 expref: 37 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.452640:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be8b621600) 00010000:00010000:0.0:1790919141.452642:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790919141.452645:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac59200, rc 0) 00000100:00100000:0.0:1790919141.452809:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+37:11531:x1877914532531712:12345-192.168.201.27@tcp:101:cat.0 Request processed in 1354us (1660us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1790919141.452818:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 196 00000100:00100000:1.0:1790919141.459608:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919141.459847:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532531968 00000100:00100000:2.0:1790919141.459858:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532531968 00000100:00100000:2.0:1790919141.459919:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 54 00000100:00100000:2.0:1790919141.459931:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+37:11531:x1877914532531968:12345-192.168.201.27@tcp:35:cat.0 00000100:00100000:2.0:1790919141.460220:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+38:11531:x1877914532531968:12345-192.168.201.27@tcp:35:cat.0 Request processed in 291us (621us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1790919141.460228:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 54 00000100:00100000:0.0:1790919141.482901:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919141.482989:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532532224 00000100:00100000:2.0:1790919141.483000:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532532224 00000100:00100000:2.0:1790919141.483077:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 197 00000100:00100000:2.0:1790919141.483088:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd827f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+38:11532:x1877914532532224:12345-192.168.201.27@tcp:36:rm.0 00010000:00010000:2.0:1790919141.483146:0:8231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1790919141.483183:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c4fa3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ceb3 expref: 38 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.483207:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c4f79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ceac expref: 37 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.483243:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c4f41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce9e expref: 36 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.483253:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be8b621600) 00010000:00010000:2.0:1790919141.483264:0:8231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790919141.483285:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fe00/0xc3296956897c4fb1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.483299:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fe00/0xc3296956897c4fb1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.483309:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fe00/0xc3296956897c4fb1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.483325:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c4fb8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.483330:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c4fb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.483337:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c4fb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.483625:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f400/0xc3296956897c4fbf lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.483634:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f400/0xc3296956897c4fbf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.483641:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f400/0xc3296956897c4fbf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790919141.484208:0:8231:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1790919141.484218:0:8231:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 343372690849ns, next at 344372688396ns, rc = 0 00010000:00010000:2.0:1790919141.484274:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f000/0xc3296956897c4fc6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.484284:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f000/0xc3296956897c4fc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.484293:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f000/0xc3296956897c4fc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.484299:0:8231:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f000/0xc3296956897c4fc6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.484305:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f000/0xc3296956897c4fc6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.484311:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f000/0xc3296956897c4fc6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.484338:0:8231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790919141.484358:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f400/0xc3296956897c4fbf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.484365:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f400/0xc3296956897c4fbf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.484371:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f400/0xc3296956897c4fbf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.484377:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be90f9f400 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919141.484387:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f400/0xc3296956897c4fbf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.484394:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f400/0xc3296956897c4fbf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.484404:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be85efc900) 00010000:00010000:2.0:1790919141.484407:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1790919141.484411:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f400/0xc3296956897c4fbf lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.484416:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f400/0xc3296956897c4fbf lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.484434:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fe00/0xc3296956897c4fb1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.484440:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fe00/0xc3296956897c4fb1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.484445:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fe00/0xc3296956897c4fb1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.484450:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be90f9fe00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919141.484453:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fe00/0xc3296956897c4fb1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.484459:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fe00/0xc3296956897c4fb1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.484467:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88be85efcd00) 00010000:00010000:2.0:1790919141.484469:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919141.484478:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fe00/0xc3296956897c4fb1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.484484:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fe00/0xc3296956897c4fb1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790919141.484494:0:8231:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000fdf90304 reply state 000000007f2513cc transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c4fb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919141.484502:0:8231:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790919141.484625:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd827f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+37:11532:x1877914532532224:12345-192.168.201.27@tcp:36:rm.0 Request processed in 1536us (1731us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1790919141.484633:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 197 00010000:00010000:3.0:1790919141.484805:0:7650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790919141.484812:0:7650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f000/0xc3296956897c4fc6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919141.484819:0:7650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be90f9f000 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:3.0:1790919141.484822:0:7650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f000/0xc3296956897c4fc6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919141.484828:0:7650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f000/0xc3296956897c4fc6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919141.484837:0:7650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88be85efc900) 00010000:00010000:3.0:1790919141.484839:0:7650:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790919141.484842:0:7650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f000/0xc3296956897c4fc6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919141.484859:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f000/0xc3296956897c4fc6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919141.484875:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919141.484876:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919141.484878:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919141.487598:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c4fb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.487633:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c4fb8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.487640:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c4fb8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.487647:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be90f9ee00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919141.487652:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c4fb8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.487659:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c4fb8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.487674:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88be85efc600) 00010000:00010000:0.0:1790919141.487677:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919141.487682:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c4fb8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.487688:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c4fb8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919141.542359:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919141.542893:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532532480 00000100:00100000:3.0:1790919141.542905:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532532480 00000100:00100000:3.0:1790919141.543029:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 198 00000100:00100000:3.0:1790919141.543040:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd827f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+36:11538:x1877914532532480:12345-192.168.201.27@tcp:101:bash.0 00010000:00010000:3.0:1790919141.543083:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919141.543105:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4fcd lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672ceba expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919141.543330:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4fd4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919141.543347:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4fd4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919141.543359:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4fd4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919141.543374:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4fdb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919141.543381:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4fdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919141.543387:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4fdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790919141.544018:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1790919141.544765:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c4fe2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919141.544780:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c4fe2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919141.544791:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c4fe2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919141.544828:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4fd4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919141.544836:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4fd4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919141.544844:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4fd4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919141.544850:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81673200 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919141.544854:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4fd4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919141.544861:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4fd4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919141.544873:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88be85efcd00) 00010000:00010000:3.0:1790919141.544876:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919141.544881:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4fd4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919141.544899:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c4fd4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790919141.544916:0:5847:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a8c97da4 reply state 00000000256636d8 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4fdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919141.544925:0:5847:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790919141.544969:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c4fcd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ceba expref: 39 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919141.544985:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c4fe2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ceba expref: 38 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919141.544993:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88be88e22f00) 00010000:00010000:3.0:1790919141.544995:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790919141.544997:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81672400, rc 0) 00000100:00100000:3.0:1790919141.545494:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd827f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+39:11538:x1877914532532480:12345-192.168.201.27@tcp:101:bash.0 Request processed in 2453us (3142us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1790919141.545502:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 198 00000100:00100000:1.0:1790919141.550775:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00010000:00010000:0.0:1790919141.551274:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4fdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.551287:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4fdb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.551295:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4fdb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.551320:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81673800 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919141.551325:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4fdb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.551333:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4fdb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.551542:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88be88e22300) 00010000:00010000:0.0:1790919141.551547:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919141.551552:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4fdb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.551559:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c4fdb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919141.551657:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532532608 00000100:00100000:3.0:1790919141.551668:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532532608 00000100:00100000:3.0:1790919141.551793:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 59 00000100:00100000:3.0:1790919141.551803:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:2352:x1877914532532608:12345-192.168.201.27@tcp:101:bash.0 00010000:00010000:3.0:1790919141.551820:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919141.551838:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003439f9ed/0xc3296956897c4ff0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cec1 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790919141.551872:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919141.551891:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=343s v=(0 0) 00010000:00010000:3.0:1790919141.551896:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919141.551905:0:6700:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003439f9ed/0xc3296956897c4ff0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cec1 expref: 8 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919141.551920:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003439f9ed/0xc3296956897c4ff0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cec1 expref: 8 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919141.551931:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81516600, rc 0) 00000100:00100000:3.0:1790919141.551996:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+8:2352:x1877914532532608:12345-192.168.201.27@tcp:101:bash.0 Request processed in 195us (1230us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919141.552003:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 59 00000100:00080000:1.0:1790919141.557271:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790919141.559107:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919141.559328:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532532736 00000100:00100000:2.0:1790919141.559338:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532532736 00000100:00100000:2.0:1790919141.559491:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 60 00000100:00100000:2.0:1790919141.559502:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+8:11538:x1877914532532736:12345-192.168.201.27@tcp:101:bash.0 00010000:00010000:2.0:1790919141.559777:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919141.559797:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f57d7f08/0xc3296956897c4ff7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cec8 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.559830:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003439f9ed/0xc3296956897c4ff0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cec1 expref: 9 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.559839:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919141.559843:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919141.559848:0:6698:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f57d7f08/0xc3296956897c4ff7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cec8 expref: 9 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.559905:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003439f9ed/0xc3296956897c4ff0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cec1 expref: 9 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.559921:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003439f9ed/0xc3296956897c4ff0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cec1 expref: 9 pid: 6700 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919141.559937:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beba14dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6698:1877914550349824:192.168.201.27@tcp:104: 00000100:00100000:2.0:1790919141.560045:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be95830480 going to sleep for 11 seconds 00000100:00100000:2.0:1790919141.563052:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beba14dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6698:1877914550349824:192.168.201.27@tcp:104: 00010000:00010000:2.0:1790919141.563101:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f57d7f08/0xc3296956897c4ff7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cec8 expref: 9 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.563121:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be90f9fe00, rc 0) 00000100:00100000:2.0:1790919141.563194:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+9:11538:x1877914532532736:12345-192.168.201.27@tcp:101:bash.0 Request processed in 3693us (4097us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919141.563203:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 60 00000100:00100000:1.0:1790919141.566621:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919141.566818:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532532864 00000100:00100000:0.0:1790919141.566829:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532532864 00010000:00010000:0.0:1790919141.566869:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003439f9ed/0xc3296956897c4ff0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cec1 expref: 9 pid: 6700 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919141.566914:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 75 00000100:00100000:0.0:1790919141.566924:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be91caf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+9:2353:x1877914532532864:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790919141.566940:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919141.566974:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003439f9ed/0xc3296956897c4ff0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cec1 expref: 9 pid: 6700 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.566988:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003439f9ed/0xc3296956897c4ff0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cec1 expref: 9 pid: 6700 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.567029:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003439f9ed/0xc3296956897c4ff0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cec1 expref: 9 pid: 6700 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.567056:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919141.567061:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919141.567076:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f57d7f08/0xc3296956897c4ff7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cec8 expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.567087:0:5830:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f57d7f08/0xc3296956897c4ff7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cec8 expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.567123:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f57d7f08/0xc3296956897c4ff7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cec8 expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919141.567138:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd827f1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5830:1877914550349952:192.168.201.27@tcp:105: 00000100:00100000:0.0:1790919141.567425:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be84f6e480 going to sleep for 11 seconds 00000100:00100000:1.0:1790919141.572444:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919141.572712:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd827f1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5830:1877914550349952:192.168.201.27@tcp:105: 00010000:00010000:0.0:1790919141.572736:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919141.572785:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be91caf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+8:2353:x1877914532532864:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 5862us (6173us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919141.572797:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 75 00000100:00100000:2.0:1790919141.572975:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532533120 00000100:00100000:2.0:1790919141.572983:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532533120 00000100:00100000:2.0:1790919141.573034:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 55 00000100:00100000:2.0:1790919141.573042:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+38:11538:x1877914532533120:12345-192.168.201.27@tcp:35:bash.0 00000100:00100000:2.0:1790919141.573380:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+39:11538:x1877914532533120:12345-192.168.201.27@tcp:35:bash.0 Request processed in 337us (945us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1790919141.573387:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 55 00010000:00010000:2.0:1790919141.631841:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919141.741254:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919141.741448:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532533248 00000100:00100000:2.0:1790919141.741459:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532533248 00000100:00100000:2.0:1790919141.741655:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 199 00000100:00100000:2.0:1790919141.741667:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+39:11554:x1877914532533248:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:2.0:1790919141.741699:0:8231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919141.741723:0:8231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f400/0xc3296956897c4ffe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cecf expref: -99 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.741793:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ea00/0xc3296956897c5005 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.741808:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ea00/0xc3296956897c5005 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.741820:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ea00/0xc3296956897c5005 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919141.741857:0:8231:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1790919141.741860:0:8231:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790919141.741879:0:8231:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ea00/0xc3296956897c5005 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.741905:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f400/0xc3296956897c4ffe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cecf expref: 41 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.741922:0:8231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ea00/0xc3296956897c5005 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cecf expref: 40 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.741931:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88be85efcd00) 00010000:00010000:2.0:1790919141.741947:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790919141.741962:0:8231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be90f9ea00, rc 0) 00000100:00100000:2.0:1790919141.742028:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+40:11554:x1877914532533248:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 363us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919141.742035:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 199 00000100:00100000:1.0:1790919141.753158:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919141.753279:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532533504 00000100:00100000:2.0:1790919141.753291:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532533504 00000100:00100000:2.0:1790919141.753370:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 200 00000100:00100000:2.0:1790919141.753383:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+40:11554:x1877914532533504:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:2.0:1790919141.753405:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919141.753428:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f400/0xc3296956897c500c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672ced6 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.753731:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c5013 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.753748:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c5013 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.753761:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c5013 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919141.753772:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1790919141.753903:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f400/0xc3296956897c500c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ced6 expref: 43 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.753921:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c5013 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ced6 expref: 42 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.753948:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88be88e22f00) 00010000:00010000:2.0:1790919141.753962:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790919141.753966:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be90f9ee00, rc 0) 00000100:00100000:2.0:1790919141.754033:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+42:11554:x1877914532533504:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 652us (884us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1790919141.754041:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 200 00000100:00100000:1.0:1790919141.758637:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919141.761742:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532533888 00000100:00100000:0.0:1790919141.761758:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532533888 00000100:00100000:0.0:1790919141.761823:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 201 00000100:00100000:3.0:1790919141.761866:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919141.761894:0:8529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532533632 00000100:00100000:3.0:1790919141.761898:0:8529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532533632 00000100:00100000:3.0:1790919141.761941:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 15 00000100:00100000:3.0:1790919141.761961:0:8529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+43:2351:x1877914532533632:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919141.761980:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919141.762006:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c5013 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ced6 expref: 43 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919141.762027:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88be88e22f00) 00010000:00010000:3.0:1790919141.762031:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919141.762095:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+42:11554:x1877914532533888:12345-192.168.201.27@tcp:101:lfs.0 00000100:00100000:3.0:1790919141.762113:0:8529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+42:2351:x1877914532533632:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 162us (247us total) trans 0 rc 0/0 00010000:00010000:0.0:1790919141.762119:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790919141.762123:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 15 00010000:00010000:0.0:1790919141.762138:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c5021 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cedd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.762260:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c5028 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.762276:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c5028 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.762286:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c5028 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919141.762297:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1790919141.762439:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c5021 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cedd expref: 44 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.762466:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c5028 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cedd expref: 43 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.762474:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88be88e22f00) 00010000:00010000:0.0:1790919141.762476:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790919141.762479:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac59e00, rc 0) 00000100:00100000:0.0:1790919141.762506:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+43:11554:x1877914532533888:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 416us (3881us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1790919141.768040:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 201 00000100:00100000:1.0:1790919141.772684:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919141.772782:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532534016 00000100:00100000:3.0:1790919141.772793:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532534016 00000100:00100000:3.0:1790919141.772922:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 61 00000100:00100000:3.0:1790919141.772933:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+8:2352:x1877914532534016:12345-192.168.201.27@tcp:1:lfs.0 00010000:00010000:3.0:1790919141.772994:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003439f9ed/0xc3296956897c5036 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919141.773017:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f57d7f08/0xc3296956897c4ff7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cec8 expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919141.773026:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919141.773030:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790919141.773035:0:6700:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003439f9ed/0xc3296956897c5036 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919141.773231:0:6700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f57d7f08/0xc3296956897c4ff7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cec8 expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919141.773249:0:6700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f57d7f08/0xc3296956897c4ff7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cec8 expref: 8 pid: 6698 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919141.773267:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b16680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6700:1877914550350080:192.168.201.27@tcp:104: 00000100:00100000:3.0:1790919141.773412:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be81254cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790919141.780237:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b16680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6700:1877914550350080:192.168.201.27@tcp:104: 00010000:00010000:3.0:1790919141.780284:0:6700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003439f9ed/0xc3296956897c5036 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919141.780838:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919141.780982:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532534144 00000100:00100000:0.0:1790919141.780990:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532534144 00002000:00100000:0.0:1790919141.781045:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff88bebf6e3800 x1877914532534144/t0(0) o4->c4a4e085-55d7-40e9-993c-11b4dfc2d5f5@192.168.201.27@tcp:262/0 lens 504/0 e 0 to 0 dl 1790919152 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790919141.781055:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88bebf6e3800 with x1877914532534144 ext(0->8) 00010000:00010000:0.0:1790919141.781064:0:6704:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f57d7f08/0xc3296956897c4ff7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cec8 expref: 9 pid: 6698 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.781079:0:6704:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f57d7f08/0xc3296956897c4ff7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cec8 expref: 9 pid: 6698 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790919141.781086:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88bebf6e3800 00000100:00100000:0.0:1790919141.781119:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 3 00000100:00100000:0.0:1790919141.781129:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+9:2353:x1877914532534144:12345-192.168.201.27@tcp:4:lfs.0 00000100:00100000:0.0:1790919141.781637:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+11:2353:x1877914532534144:12345-192.168.201.27@tcp:4:lfs.0 Request processed in 508us (800us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1790919141.781646:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 3 00002000:00100000:0.0:1790919141.781655:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff88bebf6e3800 x1877914532534144/t4294967308(0) o4->c4a4e085-55d7-40e9-993c-11b4dfc2d5f5@192.168.201.27@tcp:262/0 lens 504/448 e 0 to 0 dl 1790919152 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790919141.781663:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88bebf6e3800 with x1877914532534144 ext(0->8) 00010000:00010000:0.0:1790919141.781669:0:6704:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f57d7f08/0xc3296956897c4ff7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cec8 expref: 11 pid: 6698 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.781682:0:6704:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f57d7f08/0xc3296956897c4ff7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cec8 expref: 11 pid: 6698 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790919141.781688:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88bebf6e3800 00000100:00100000:1.0:1790919141.787306:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919141.787428:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532534272 00000100:00100000:3.0:1790919141.787439:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532534272 00010000:00010000:3.0:1790919141.787479:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f57d7f08/0xc3296956897c4ff7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cec8 expref: 11 pid: 6698 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919141.787512:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 76 00000100:00100000:3.0:1790919141.787522:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+11:2352:x1877914532534272:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919141.787564:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1790919141.787582:0:5829:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1790919141.787585:0:5829:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1790919142 00002000:00010000:3.0:1790919141.787587:0:5829:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1790919142 00002000:00010000:3.0:1790919141.787589:0:5829:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1790919142 00010000:00010000:3.0:1790919141.787596:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f57d7f08/0xc3296956897c4ff7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cec8 expref: 11 pid: 6698 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919141.787608:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f57d7f08/0xc3296956897c4ff7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cec8 expref: 11 pid: 6698 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919141.787631:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f57d7f08/0xc3296956897c4ff7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cec8 expref: 11 pid: 6698 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919141.787648:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790919141.787652:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790919141.787671:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003439f9ed/0xc3296956897c5036 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919141.787681:0:5829:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003439f9ed/0xc3296956897c5036 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919141.787709:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919141.787773:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+10:2352:x1877914532534272:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 253us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919141.787781:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 76 00010000:00010000:1.0:1790919141.791047:0:6700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003439f9ed/0xc3296956897c5036 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919141.791078:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003439f9ed/0xc3296956897c5036 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919141.791129:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003439f9ed/0xc3296956897c5036 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919141.791138:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003439f9ed/0xc3296956897c5036 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919141.791146:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003439f9ed/0xc3296956897c5036 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919141.791172:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81516600 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:1.0:1790919141.791178:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003439f9ed/0xc3296956897c5036 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919141.791189:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003439f9ed/0xc3296956897c5036 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919141.791212:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003439f9ed/0xc3296956897c5036 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919141.791219:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003439f9ed/0xc3296956897c5036 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919141.792356:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+9:2352:x1877914532534016:12345-192.168.201.27@tcp:1:lfs.0 Request processed in 19416us (19674us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919141.792368:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 61 00000100:00100000:1.0:1790919141.794683:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919141.794947:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532534528 00000100:00100000:2.0:1790919141.794971:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532534528 00000100:00100000:2.0:1790919141.795032:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 56 00000100:00100000:2.0:1790919141.795043:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9290b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+43:11554:x1877914532534528:12345-192.168.201.27@tcp:35:lfs.0 00000004:00010000:2.0:1790919141.795115:0:5849:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c5028 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cedd expref: 43 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790919141.795370:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:2.0:1790919141.795411:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1790919141.796327:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1790919141.796393:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f000/0xc3296956897c503d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.796409:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c4fe2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ceba expref: 47 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.796419:0:5849:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f000/0xc3296956897c503d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.796523:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c4fe2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ceba expref: 47 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.796597:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c4fe2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ceba expref: 47 pid: 5847 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919141.796613:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beba14dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5849:1877914550350208:192.168.201.27@tcp:104: 00000100:00100000:2.0:1790919141.796716:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be814c2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790919141.799985:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beba14dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5849:1877914550350208:192.168.201.27@tcp:104: 00010000:00010000:1.0:1790919141.800019:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f000/0xc3296956897c503d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919141.800967:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919141.806488:0:8529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532534656 00000100:00100000:3.0:1790919141.806504:0:8529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532534656 00010000:00010000:2.0:1790919141.806674:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c4fe2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ceba expref: 48 pid: 5847 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919141.806781:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 77 00000100:00100000:2.0:1790919141.806792:0:8529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+48:2352:x1877914532534656:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790919141.806810:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919141.806817:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c4fe2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ceba expref: 48 pid: 5847 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.806831:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c4fe2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ceba expref: 48 pid: 5847 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.806855:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c4fe2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ceba expref: 48 pid: 5847 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.806879:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88be88e22f00) 00010000:00010000:2.0:1790919141.806884:0:8529:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f000/0xc3296956897c503d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.806895:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f000/0xc3296956897c503d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.806920:0:8529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f000/0xc3296956897c503d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.807015:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919141.807102:0:8529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+47:2352:x1877914532534656:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 311us (6137us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919141.807111:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 77 00010000:00010000:1.0:1790919141.808656:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f000/0xc3296956897c503d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919141.808672:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f000/0xc3296956897c503d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790919141.809155:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1790919141.809485:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1790919141.810322:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd827f1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1877914550350336:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790919141.810394:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919141.810436:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be84f6e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790919141.810503:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550350336 00000100:00100000:1.0:1790919141.810511:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550350336 00000100:00100000:1.0:1790919141.810594:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790919141.810604:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd827f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5849:x1877914550350336:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1790919141.810692:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd827f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5849:x1877914550350336:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 89us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919141.810941:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd827f1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1877914550350336:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1790919141.811504:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1790919141.813910:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd827f1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1877914550350464:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790919141.813997:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919141.814035:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be84f6ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1790919141.814282:0:5850:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1790919141.814293:0:5850:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1790919141.814513:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790919141.814946:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550350464 00000100:00100000:3.0:1790919141.814963:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550350464 00000100:00100000:3.0:1790919141.815007:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790919141.815016:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd827f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5849:x1877914550350464:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1790919141.815358:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd827f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5849:x1877914550350464:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 342us (1360us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1790919141.815366:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790919141.815565:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd827f1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1877914550350464:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1790919141.815727:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1790919141.815789:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f000/0xc3296956897c503d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919141.815801:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f000/0xc3296956897c503d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919141.815808:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f000/0xc3296956897c503d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919141.815814:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be90f9f000 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:1.0:1790919141.815818:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f000/0xc3296956897c503d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919141.815826:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f000/0xc3296956897c503d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919141.815843:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88be88e22f00) 00010000:00010000:1.0:1790919141.815867:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1790919141.815872:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f000/0xc3296956897c503d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919141.815878:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f000/0xc3296956897c503d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790919141.816095:0:5849:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1790919141.816213:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1790919141.816224:0:5849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 343704697292ns, next at 344704695412ns, rc = 0 00000001:00080000:1.0:1790919141.816232:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1790919141.816262:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88be88e22f00) 00010000:00010000:1.0:1790919141.816266:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1790919141.816272:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c5028 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cedd expref: 51 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919141.816392:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9290b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+50:11554:x1877914532534528:12345-192.168.201.27@tcp:35:lfs.0 Request processed in 21351us (21718us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1790919141.816401:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 56 00000020:00080000:1.0:1790919141.816406:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1790919141.819809:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919141.819893:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532534784 00000100:00100000:0.0:1790919141.819904:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532534784 00000100:00100000:0.0:1790919141.819998:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 202 00000100:00100000:0.0:1790919141.820010:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+50:11554:x1877914532534784:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:0.0:1790919141.820034:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919141.820063:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c5044 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cee4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.820152:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c5044 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cee4 expref: 51 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.820169:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c5044 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cee4 expref: 51 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.820191:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88be853b5800) 00010000:00010000:0.0:1790919141.820194:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790919141.820199:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac58200, rc 0) 00000100:00100000:0.0:1790919141.820265:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+51:11554:x1877914532534784:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 256us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919141.820291:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 202 00000100:00100000:3.0:1790919141.824617:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919141.824714:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532535040 00000100:00100000:1.0:1790919141.824725:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532535040 00000100:00100000:1.0:1790919141.824774:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 57 00000100:00100000:1.0:1790919141.824931:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+51:11554:x1877914532535040:12345-192.168.201.27@tcp:35:lfs.0 00000100:00100000:1.0:1790919141.825212:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+52:11554:x1877914532535040:12345-192.168.201.27@tcp:35:lfs.0 Request processed in 429us (606us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1790919141.825220:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 57 00000100:00100000:1.0:1790919141.910937:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919141.911263:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532535168 00000100:00100000:2.0:1790919141.911276:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532535168 00000100:00100000:2.0:1790919141.911344:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 203 00000100:00100000:2.0:1790919141.911355:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+52:11564:x1877914532535168:12345-192.168.201.27@tcp:34:lfs.0 00010000:00010000:2.0:1790919141.911436:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c504b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.911454:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c504b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.911466:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c504b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.911480:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e600/0xc3296956897c5052 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.911486:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e600/0xc3296956897c5052 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.911493:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e600/0xc3296956897c5052 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.911636:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e400/0xc3296956897c5059 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.911644:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e400/0xc3296956897c5059 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.911651:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e400/0xc3296956897c5059 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790919141.911706:0:8231:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e400/0xc3296956897c5059 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.911718:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c504b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.911725:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c504b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.911732:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c504b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.911739:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be90f9f600 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919141.911743:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c504b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.911751:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c504b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.911766:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88be85efcd00) 00010000:00010000:2.0:1790919141.911770:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919141.911775:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c504b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.911786:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c504b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.911800:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e600/0xc3296956897c5052 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.911806:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e600/0xc3296956897c5052 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.911811:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e600/0xc3296956897c5052 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.911816:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be90f9e600 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919141.911819:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e600/0xc3296956897c5052 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.911825:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e600/0xc3296956897c5052 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.911832:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88be85efc300) 00010000:00010000:2.0:1790919141.911835:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919141.911837:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e600/0xc3296956897c5052 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.911843:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e600/0xc3296956897c5052 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.911858:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e400/0xc3296956897c5059 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.911865:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e400/0xc3296956897c5059 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.911876:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e400/0xc3296956897c5059 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.911881:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be90f9e400 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919141.911884:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e400/0xc3296956897c5059 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.911890:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e400/0xc3296956897c5059 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.911898:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88be853b5800) 00010000:00010000:2.0:1790919141.911901:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919141.911903:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e400/0xc3296956897c5059 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919141.911909:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e400/0xc3296956897c5059 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919141.912002:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+52:11564:x1877914532535168:12345-192.168.201.27@tcp:34:lfs.0 Request processed in 648us (1075us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919141.912010:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 203 00000100:00100000:2.0:1790919141.948179:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919141.948330:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532535424 00000100:00100000:0.0:1790919141.948341:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532535424 00000100:00100000:0.0:1790919141.948400:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 204 00000100:00100000:0.0:1790919141.948412:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba14ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+52:11567:x1877914532535424:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:0.0:1790919141.948433:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919141.948454:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59c00/0xc3296956897c5060 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672ceeb expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.948554:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c5067 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.948570:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c5067 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.948581:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c5067 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.948598:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c506e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.948604:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c506e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.948610:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c506e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.948749:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c5075 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.948774:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c5075 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.948782:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c5075 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919141.948793:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1790919141.948897:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c5067 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.948905:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c5067 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.948911:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c5067 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.948918:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac59e00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919141.948923:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c5067 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.948931:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c5067 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.948943:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88be85efcd00) 00010000:00010000:0.0:1790919141.948959:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919141.948964:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c5067 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.948971:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c5067 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.948984:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c506e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.948996:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c506e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.949001:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c506e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.949006:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac59000 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919141.949009:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c506e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.949015:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c506e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.949024:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88be853b5700) 00010000:00010000:0.0:1790919141.949026:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919141.949029:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c506e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.949034:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c506e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.949087:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59c00/0xc3296956897c5060 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ceeb expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.949101:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c5075 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ceeb expref: 54 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.949108:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88be853b5800) 00010000:00010000:0.0:1790919141.949110:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790919141.949119:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac59400, rc 0) 00000100:00100000:0.0:1790919141.949189:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba14ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+54:11567:x1877914532535424:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 780us (1019us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1790919141.949198:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 204 00000100:00100000:3.0:1790919141.952753:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919141.952899:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532535552 00000100:00100000:0.0:1790919141.952909:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532535552 00000100:00100000:0.0:1790919141.952984:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 205 00000100:00100000:0.0:1790919141.952995:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+54:11567:x1877914532535552:12345-192.168.201.27@tcp:54:lfs.0 00010000:00010000:0.0:1790919141.953241:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c5083 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.953261:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c5083 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.953273:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c5083 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.953307:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c5083 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.953315:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c5083 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.953323:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c5083 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.953329:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac58000 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919141.953334:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c5083 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.953342:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c5083 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.953375:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88be853b5800) 00010000:00010000:0.0:1790919141.953378:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790919141.953383:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c5083 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919141.953389:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c5083 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919141.953467:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+54:11567:x1877914532535552:12345-192.168.201.27@tcp:54:lfs.0 Request processed in 473us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919141.953475:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 205 00000100:00100000:1.0:1790919141.955999:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919141.956083:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532535808 00000100:00100000:0.0:1790919141.956091:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532535808 00000100:00100000:0.0:1790919141.956142:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 58 00000100:00100000:0.0:1790919141.956152:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+54:11567:x1877914532535808:12345-192.168.201.27@tcp:35:lfs.0 00000100:00100000:0.0:1790919141.956381:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+55:11567:x1877914532535808:12345-192.168.201.27@tcp:35:lfs.0 Request processed in 230us (391us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1790919141.956388:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 58 00000100:00100000:2.0:1790919142.018394:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919142.018495:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532536064 00000100:00100000:0.0:1790919142.018505:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532536064 00000100:00100000:0.0:1790919142.018611:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 206 00000100:00100000:0.0:1790919142.018623:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba14d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+55:11577:x1877914532536064:12345-192.168.201.27@tcp:101:bash.0 00010000:00010000:0.0:1790919142.018648:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919142.018652:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790919142.018678:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ea00/0xc3296956897c5005 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cecf expref: 55 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.018725:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88be85efcd00) 00010000:00010000:0.0:1790919142.018730:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790919142.018746:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c508a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cef2 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.018842:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59c00/0xc3296956897c5091 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.018855:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c5075 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ceeb expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.018863:0:5845:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59c00/0xc3296956897c5091 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.018896:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c5075 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ceeb expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.018910:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c5075 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ceeb expref: 55 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919142.018923:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd827f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1877914550350592:192.168.201.27@tcp:104: 00000100:00100000:0.0:1790919142.019030:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be9968d180 going to sleep for 11 seconds 00000100:00080000:1.0:1790919142.019578:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790919142.022601:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd827f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1877914550350592:192.168.201.27@tcp:104: 00010000:00010000:0.0:1790919142.022635:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59c00/0xc3296956897c5091 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919142.023755:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919142.024033:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532536192 00000100:00100000:3.0:1790919142.024054:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532536192 00010000:00010000:3.0:1790919142.024101:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c5075 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ceeb expref: 56 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919142.024160:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 78 00000100:00100000:3.0:1790919142.024172:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba14ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+56:2353:x1877914532536192:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919142.024205:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919142.024213:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c5075 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ceeb expref: 56 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.024225:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c5075 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ceeb expref: 56 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.024247:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c5075 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672ceeb expref: 56 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.024262:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88be853b5800) 00010000:00010000:3.0:1790919142.024267:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59c00/0xc3296956897c5091 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.024276:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59c00/0xc3296956897c5091 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.024284:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59c00/0xc3296956897c5091 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.024313:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919142.024369:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba14ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+55:2353:x1877914532536192:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 200us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919142.024377:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 78 00010000:00010000:2.0:1790919142.024782:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59c00/0xc3296956897c5091 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919142.024791:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59c00/0xc3296956897c5091 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919142.024824:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1790919142.025009:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c508a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cef2 expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919142.025026:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59c00/0xc3296956897c5091 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cef2 expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919142.025035:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88be853b5800) 00010000:00010000:2.0:1790919142.025038:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790919142.025041:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac59c00, rc 0) 00000100:00100000:2.0:1790919142.025099:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba14d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+55:11577:x1877914532536064:12345-192.168.201.27@tcp:101:bash.0 Request processed in 6478us (6714us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1790919142.025106:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 206 00000100:00100000:2.0:1790919142.027481:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919142.027754:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532536448 00000100:00100000:0.0:1790919142.027778:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532536448 00000100:00100000:0.0:1790919142.027863:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 207 00000100:00100000:0.0:1790919142.027872:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba14ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+55:11577:x1877914532536448:12345-192.168.201.27@tcp:36:bash.0 00010000:00010000:0.0:1790919142.028268:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c509f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.028281:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c509f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.028289:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c509f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790919142.028329:0:8231:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1790919142.028345:0:8231:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004b07696b reply state 00000000ee98dee9 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c509f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919142.028351:0:8231:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790919142.028465:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba14ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+58:11577:x1877914532536448:12345-192.168.201.27@tcp:36:bash.0 Request processed in 594us (996us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1790919142.028473:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 207 00000020:00080000:0.0:1790919142.028478:0:8231:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1790919142.030350:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00010000:00010000:0.0:1790919142.030424:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c509f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919142.030431:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532536576 00010000:00010000:0.0:1790919142.030436:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c509f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.030444:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c509f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919142.030448:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532536576 00010000:00010000:0.0:1790919142.030449:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac59000 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919142.030454:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c509f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.030475:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c509f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.030492:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88be853b5800) 00010000:00010000:0.0:1790919142.030495:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790919142.030496:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 208 00010000:00010000:0.0:1790919142.030500:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c509f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919142.030504:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd82801f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+58:11577:x1877914532536576:12345-192.168.201.27@tcp:101:bash.0 00010000:00010000:0.0:1790919142.030506:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c509f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.030555:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919142.030573:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c50a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cef9 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.030691:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c50ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.030715:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59c00/0xc3296956897c5091 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cef2 expref: 58 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.030724:0:5847:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c50ad lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.030759:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59c00/0xc3296956897c5091 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cef2 expref: 58 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.030769:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59c00/0xc3296956897c5091 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cef2 expref: 58 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919142.030780:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1877914550350720:192.168.201.27@tcp:104: 00000100:00100000:3.0:1790919142.030928:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be81254cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790919142.032840:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919142.033063:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1877914550350720:192.168.201.27@tcp:104: 00010000:00010000:3.0:1790919142.033092:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c50ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919142.033838:0:8529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532536704 00000100:00100000:2.0:1790919142.033847:0:8529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532536704 00010000:00010000:2.0:1790919142.033884:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59c00/0xc3296956897c5091 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cef2 expref: 59 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919142.033915:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 79 00000100:00100000:2.0:1790919142.033924:0:8529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd82803100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+59:2352:x1877914532536704:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790919142.033941:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919142.033959:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59c00/0xc3296956897c5091 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cef2 expref: 59 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919142.033971:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59c00/0xc3296956897c5091 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cef2 expref: 59 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919142.034007:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59c00/0xc3296956897c5091 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cef2 expref: 59 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919142.034022:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88be853b5800) 00010000:00010000:2.0:1790919142.034027:0:8529:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c50ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919142.034036:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c50ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919142.034093:0:8529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c50ad lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919142.034124:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790919142.034298:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c50ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.034306:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c50ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919142.034360:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1790919142.034365:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790919142.034384:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c50ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.034414:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c50a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cef9 expref: 59 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.034429:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c50ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cef9 expref: 58 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919142.034601:0:8529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd82803100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+58:2352:x1877914532536704:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 677us (1767us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919142.034619:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 79 00010000:00010000:3.0:1790919142.034678:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88be853b5800) 00010000:00010000:3.0:1790919142.034683:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790919142.034686:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81672c00, rc 0) 00000100:00100000:3.0:1790919142.034714:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd82801f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+57:11577:x1877914532536576:12345-192.168.201.27@tcp:101:bash.0 Request processed in 4210us (4373us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919142.034721:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 208 00000100:00100000:1.0:1790919142.043891:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919142.044023:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532536960 00000100:00100000:0.0:1790919142.044033:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532536960 00000100:00100000:0.0:1790919142.044098:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 59 00000100:00100000:0.0:1790919142.044108:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+57:11577:x1877914532536960:12345-192.168.201.27@tcp:35:bash.0 00000100:00100000:0.0:1790919142.044347:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+58:11577:x1877914532536960:12345-192.168.201.27@tcp:35:bash.0 Request processed in 241us (468us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1790919142.044356:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 59 00000100:00100000:1.0:1790919142.097657:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919142.097780:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532537088 00000100:00100000:2.0:1790919142.097791:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532537088 00000100:00100000:2.0:1790919142.097889:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 209 00000100:00100000:2.0:1790919142.097900:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+58:11583:x1877914532537088:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:2.0:1790919142.097927:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919142.097962:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e000/0xc3296956897c50b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cf00 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919142.098031:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f800/0xc3296956897c50bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919142.098297:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f800/0xc3296956897c50bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919142.098308:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f800/0xc3296956897c50bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919142.098344:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1790919142.098349:0:5846:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790919142.098368:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f800/0xc3296956897c50bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919142.098393:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e000/0xc3296956897c50b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf00 expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919142.098412:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f800/0xc3296956897c50bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf00 expref: 59 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919142.098422:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88be85efcd00) 00010000:00010000:2.0:1790919142.098425:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790919142.098429:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be90f9f800, rc 0) 00000100:00100000:2.0:1790919142.098582:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+59:11583:x1877914532537088:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 682us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919142.098589:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 209 00000100:00100000:2.0:1790919142.103308:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919142.105013:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532537216 00000100:00100000:0.0:1790919142.105026:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532537216 00000100:00100000:0.0:1790919142.105215:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 210 00000100:00100000:0.0:1790919142.105224:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba14df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+59:11583:x1877914532537216:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:0.0:1790919142.105243:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919142.105262:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c50c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cf07 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.105331:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c50c9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.105357:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c50c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.105366:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c50c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.105377:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c50d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.105381:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c50d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.105385:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c50d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.105469:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c50d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.105477:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c50d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.105483:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c50d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919142.105516:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1790919142.105519:0:5845:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790919142.105565:0:5845:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c50d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.105574:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c50d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.105588:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c50c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.105593:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c50c9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.105598:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c50c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.105602:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac59e00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919142.105605:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c50c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.105610:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c50c9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.105621:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88be85efcd00) 00010000:00010000:0.0:1790919142.105624:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919142.105628:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c50c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.105633:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c50c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.105645:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c50d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.105651:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c50d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.105656:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c50d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.105668:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac58c00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919142.105671:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c50d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.105677:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c50d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.105685:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88be853b5700) 00010000:00010000:0.0:1790919142.105687:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919142.105690:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c50d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.105695:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c50d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.105728:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59000/0xc3296956897c50c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf07 expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.105741:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c50d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf07 expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.105746:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88be853b5800) 00010000:00010000:0.0:1790919142.105747:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790919142.105749:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac59200, rc 0) 00000100:00100000:0.0:1790919142.105798:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba14df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+60:11583:x1877914532537216:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 576us (2502us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919142.105803:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 210 00000100:00100000:1.0:1790919142.111633:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919142.112591:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532537472 00000100:00100000:0.0:1790919142.112619:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532537472 00000100:00100000:0.0:1790919142.112691:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 211 00000100:00100000:0.0:1790919142.112701:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+60:11583:x1877914532537472:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:0.0:1790919142.112723:0:8231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919142.112744:0:8231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c50de lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cf0e expref: -99 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.112849:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c50e5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.112865:0:8231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c50ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cef9 expref: 61 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.112874:0:8231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c50d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf07 expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.112883:0:8231:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c50e5 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.112921:0:8231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c50d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf07 expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.112935:0:8231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c50d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf07 expref: 61 pid: 5845 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919142.112960:0:8231:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd827f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8231:1877914550350848:192.168.201.27@tcp:104: 00010000:00010000:0.0:1790919142.113085:0:8231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c50ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cef9 expref: 61 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.113108:0:8231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c50ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cef9 expref: 61 pid: 5847 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919142.113118:0:8231:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd827f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8231:1877914550350976:192.168.201.27@tcp:104: 00000100:00100000:3.0:1790919142.113126:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919142.113150:0:8231:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be9968d180 going to sleep for 11 seconds 00000100:00100000:3.0:1790919142.113163:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532537600 00000100:00100000:3.0:1790919142.113169:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532537600 00010000:00010000:3.0:1790919142.113190:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c50d7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf07 expref: 62 pid: 5845 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919142.113230:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 80 00000100:00100000:3.0:1790919142.113238:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+62:2351:x1877914532537600:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919142.113247:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919142.113253:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c50d7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf07 expref: 62 pid: 5845 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.113273:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c50d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf07 expref: 62 pid: 5845 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.113294:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88be853b5800) 00010000:00010000:3.0:1790919142.113298:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c50e5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.113306:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c50e5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.113313:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919142.113338:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+62:2351:x1877914532537600:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 101us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919142.113345:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 80 00010000:00010000:0.0:1790919142.119123:0:8231:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.27@tcp) returned -22 from blocking AST (req@000000001eabf025 x1877914550350848) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c50d7 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf07 expref: 61 pid: 5845 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.119148:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c50d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf07 expref: 61 pid: 5845 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919142.119165:0:8231:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd827f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8231:1877914550350848:192.168.201.27@tcp:104: 00000100:00100000:0.0:1790919142.119178:0:8231:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd827f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8231:1877914550350976:192.168.201.27@tcp:104: 00010000:00010000:0.0:1790919142.119204:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88be853b5800) 00010000:00010000:0.0:1790919142.119209:0:8231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c50e5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.119218:0:8231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c50e5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.119228:0:8231:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c50e5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919142.122106:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919142.122437:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532537728 00000100:00100000:3.0:1790919142.122448:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532537728 00010000:00010000:3.0:1790919142.122490:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c50ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cef9 expref: 61 pid: 5847 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919142.122574:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 81 00000100:00100000:3.0:1790919142.122584:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be91cae850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+61:2353:x1877914532537728:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919142.122600:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919142.122606:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c50ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cef9 expref: 61 pid: 5847 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.122620:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c50ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cef9 expref: 61 pid: 5847 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.122659:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c50ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cef9 expref: 61 pid: 5847 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.122677:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88be853b5800) 00010000:00010000:3.0:1790919142.122682:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c50e5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.122788:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c50e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.122797:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c50e5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.122870:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919142.122951:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be91cae850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+60:2353:x1877914532537728:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 360us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919142.122960:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 81 00010000:00010000:1.0:1790919142.123801:0:8231:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c50e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919142.123811:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c50e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790919142.123828:0:8231:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1790919142.123971:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c50de lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf0e expref: 61 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919142.123991:0:8231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c50e5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf0e expref: 60 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919142.123999:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88be853b5800) 00010000:00010000:1.0:1790919142.124002:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790919142.124006:0:8231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac59a00, rc 0) 00000100:00100000:1.0:1790919142.124334:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+60:11583:x1877914532537472:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 11634us (12710us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1790919142.124342:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 211 00000100:00100000:1.0:1790919142.127437:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919142.127518:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532537984 00000100:00100000:3.0:1790919142.127553:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532537984 00000100:00100000:3.0:1790919142.127614:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 16 00000100:00100000:3.0:1790919142.127624:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88d98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+60:11583:x1877914532537984:12345-192.168.201.27@tcp:103:lfs.0 00010000:00010000:3.0:1790919142.127641:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919142.127664:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c5044 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cee4 expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.127681:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88be853b5800) 00010000:00010000:3.0:1790919142.127685:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919142.127749:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88d98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+59:11583:x1877914532537984:12345-192.168.201.27@tcp:103:lfs.0 Request processed in 127us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919142.127754:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 16 00000100:00100000:2.0:1790919142.129491:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919142.129598:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532538112 00000100:00100000:3.0:1790919142.129605:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532538112 00000100:00100000:3.0:1790919142.129648:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 212 00000100:00100000:3.0:1790919142.129658:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba14f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+59:11583:x1877914532538112:12345-192.168.201.27@tcp:58:lfs.0 00010000:00010000:3.0:1790919142.129762:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c50f3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.129775:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c50f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.129783:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c50f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790919142.129954:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1790919142.130065:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba14f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+59:11583:x1877914532538112:12345-192.168.201.27@tcp:58:lfs.0 Request processed in 409us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919142.130071:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 212 00000100:00100000:1.0:1790919142.135614:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919142.135844:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532538240 00000100:00100000:3.0:1790919142.135859:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532538240 00000100:00100000:3.0:1790919142.135921:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 213 00000100:00100000:3.0:1790919142.135931:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+59:11583:x1877914532538240:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:3.0:1790919142.135961:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919142.135982:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c50fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cf15 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.136050:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c50f3 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.136081:0:5846:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c50fa lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf15 expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.136100:0:5846:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c50f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.136113:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c50fa lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf15 expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.136128:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88be853b5800) 00010000:00010000:3.0:1790919142.136134:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790919142.136140:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c50fa lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf15 expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.136147:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81672c00, rc 0) 00000100:00100000:3.0:1790919142.136206:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+60:11583:x1877914532538240:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 277us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919142.136212:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 213 00000001:00080000:1.0:1790919142.220074:0:7662:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:1.0:1790919142.220097:0:7662:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:1.0:1790919142.220110:0:7662:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:1.0:1790919142.220115:0:7662:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00010000:00010000:1.0:1790919142.655804:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790919142.787238:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790919142.787248:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790919142.787306:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1790919142.787311:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790919142.787432:0:11708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd827f3b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11708:1877914550351104:192.168.201.27@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790919142.787563:0:11708:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be9f8a43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919142.792140:0:11708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd827f3b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11708:1877914550351104:192.168.201.27@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790919142.797181:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919142.797282:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532538368 00000100:00100000:3.0:1790919142.797292:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532538368 00000100:00100000:3.0:1790919142.797358:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 214 00000100:00100000:3.0:1790919142.797368:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba14d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+60:11584:x1877914532538368:12345-192.168.201.27@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790919142.797402:0:5847:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790919142.797508:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba14d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+60:11584:x1877914532538368:12345-192.168.201.27@tcp:53:lhsmtool_posix.0 Request processed in 141us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919142.797516:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 214 00000100:00100000:1.0:1790919142.808151:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919142.808239:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532538496 00000100:00100000:3.0:1790919142.808250:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532538496 00000100:00100000:3.0:1790919142.808310:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 215 00000100:00100000:3.0:1790919142.808320:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88d99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+60:11584:x1877914532538496:12345-192.168.201.27@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1790919142.808393:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c5101 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.808411:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c5101 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.808422:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c5101 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.808438:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c5108 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.808445:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c5108 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.808450:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c5108 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.808474:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3c00/0xc3296956897c510f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.808483:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3c00/0xc3296956897c510f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.808488:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3c00/0xc3296956897c510f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919142.808548:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1790919142.808568:0:5846:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790919142.808781:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3c00/0xc3296956897c510f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.808794:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c5101 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.808801:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c5101 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.808808:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c5101 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.808814:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81673200 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919142.808818:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c5101 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.808826:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c5101 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.808838:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88be85efcb00) 00010000:00010000:3.0:1790919142.808841:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919142.808846:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c5101 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.808852:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673200/0xc3296956897c5101 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.808866:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c5108 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.808871:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c5108 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.808887:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c5108 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.808891:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81672400 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919142.808894:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c5108 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.808899:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c5108 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.808906:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff88be88e22300) 00010000:00010000:3.0:1790919142.808908:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919142.808912:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c5108 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.808917:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672400/0xc3296956897c5108 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.808940:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3c00/0xc3296956897c510f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.808946:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3c00/0xc3296956897c510f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.808951:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3c00/0xc3296956897c510f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.808956:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be813a3c00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919142.808959:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3c00/0xc3296956897c510f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.808982:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3c00/0xc3296956897c510f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.808991:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88be853b5800) 00010000:00010000:3.0:1790919142.808993:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919142.808996:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3c00/0xc3296956897c510f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.809001:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3c00/0xc3296956897c510f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919142.809213:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88d99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+60:11584:x1877914532538496:12345-192.168.201.27@tcp:34:lhsmtool_posix.0 Request processed in 893us (1071us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919142.809223:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 215 00000100:00100000:1.0:1790919142.823913:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919142.824438:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532538752 00000100:00100000:3.0:1790919142.824449:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532538752 00000100:00100000:3.0:1790919142.824510:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 216 00000100:00100000:3.0:1790919142.824520:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb40e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+60:11584:x1877914532538752:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790919142.824790:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919142.824813:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3c00/0xc3296956897c5116 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cf1c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.824924:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2800/0xc3296956897c511d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.824946:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2800/0xc3296956897c511d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.824958:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2800/0xc3296956897c511d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919142.824994:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1790919142.825104:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2800/0xc3296956897c511d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.825113:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2800/0xc3296956897c511d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.825121:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2800/0xc3296956897c511d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.825127:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be813a2800 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919142.825132:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2800/0xc3296956897c511d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.825139:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2800/0xc3296956897c511d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.825153:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88be853b5800) 00010000:00010000:3.0:1790919142.825156:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790919142.825161:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2800/0xc3296956897c511d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.825166:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2800/0xc3296956897c511d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.825206:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3c00/0xc3296956897c5116 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf1c expref: 62 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.825215:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88be85efcb00) 00010000:00010000:3.0:1790919142.825217:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790919142.825240:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3c00/0xc3296956897c5116 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf1c expref: 62 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.825250:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be813a3c00, rc 0) 00000100:00100000:3.0:1790919142.825320:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb40e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+61:11584:x1877914532538752:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 802us (1418us total) trans 4294967503 rc 301/301 00000100:00100000:3.0:1790919142.825328:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 216 00000100:00100000:2.0:1790919142.836347:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919142.836675:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532538880 00000100:00100000:1.0:1790919142.836698:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532538880 00000100:00100000:1.0:1790919142.836767:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 217 00000100:00100000:1.0:1790919142.836778:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba14f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+61:11584:x1877914532538880:12345-192.168.201.27@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790919142.836817:0:8231:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790919142.836926:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba14f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+61:11584:x1877914532538880:12345-192.168.201.27@tcp:53:lhsmtool_posix.0 Request processed in 149us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919142.836942:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 217 00000100:00100000:1.0:1790919142.853254:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919142.853493:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532539136 00000100:00100000:0.0:1790919142.853503:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532539136 00000100:00100000:0.0:1790919142.853668:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 218 00000100:00100000:0.0:1790919142.853689:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf789f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+61:11584:x1877914532539136:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790919142.853711:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919142.853714:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790919142.853741:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f800/0xc3296956897c50bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf00 expref: 61 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.853760:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88be85efcd00) 00010000:00010000:0.0:1790919142.853765:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790919142.853779:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c512b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cf23 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790919142.855067:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1790919142.855499:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ec00/0xc3296956897c5132 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919142.855515:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ec00/0xc3296956897c5132 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919142.855574:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ec00/0xc3296956897c5132 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919142.855863:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c512b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf23 expref: 63 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919142.855882:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ec00/0xc3296956897c5132 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf23 expref: 62 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919142.855892:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88be85efc300) 00010000:00010000:2.0:1790919142.855895:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790919142.855898:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be90f9ec00, rc 0) 00000100:00100000:2.0:1790919142.856111:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf789f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+62:11584:x1877914532539136:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 2433us (2868us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1790919142.856120:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 218 00000100:00100000:2.0:1790919142.868979:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919142.869080:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532539392 00000100:00100000:1.0:1790919142.869092:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532539392 00000100:00100000:1.0:1790919142.869155:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 219 00000100:00100000:1.0:1790919142.869166:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba14e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+62:11584:x1877914532539392:12345-192.168.201.27@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790919142.869238:0:8231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919142.869267:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ec00/0xc3296956897c5132 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf23 expref: 62 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919142.869290:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88be85efc300) 00010000:00010000:1.0:1790919142.869304:0:8231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790919142.869347:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f600/0xc3296956897c5140 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919142.869362:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f600/0xc3296956897c5140 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919142.869373:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f600/0xc3296956897c5140 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919142.869387:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e000/0xc3296956897c5147 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x1d88d1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919142.869392:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e000/0xc3296956897c5147 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1d88d1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919142.869399:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e000/0xc3296956897c5147 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1d88d1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919142.869476:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f600/0xc3296956897c5140 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919142.869483:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f600/0xc3296956897c5140 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919142.869490:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f600/0xc3296956897c5140 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919142.869496:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88beb3f7f600 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:1.0:1790919142.869501:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f600/0xc3296956897c5140 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919142.869508:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f600/0xc3296956897c5140 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919142.869562:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88be85efcd00) 00010000:00010000:1.0:1790919142.869566:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919142.869570:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f600/0xc3296956897c5140 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919142.869577:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f600/0xc3296956897c5140 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919142.869588:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e000/0xc3296956897c5147 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1d88d1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919142.869594:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e000/0xc3296956897c5147 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1d88d1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919142.869599:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e000/0xc3296956897c5147 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1d88d1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919142.869604:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88beb3f7e000 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:1.0:1790919142.869606:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e000/0xc3296956897c5147 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1d88d1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919142.869612:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e000/0xc3296956897c5147 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1d88d1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919142.869619:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x1d88d1d9 (ffff88be8b621a00) 00010000:00010000:1.0:1790919142.869621:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919142.869624:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e000/0xc3296956897c5147 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x1d88d1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919142.869629:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e000/0xc3296956897c5147 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x1d88d1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919142.869724:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba14e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+61:11584:x1877914532539392:12345-192.168.201.27@tcp:36:lhsmtool_posix.0 Request processed in 559us (754us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790919142.869732:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 219 00000100:00100000:1.0:1790919142.871690:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919142.871769:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532539520 00000100:00100000:3.0:1790919142.871792:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532539520 00000100:00100000:3.0:1790919142.871848:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 220 00000100:00100000:3.0:1790919142.871858:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf78b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+61:11584:x1877914532539520:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790919142.871880:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919142.871903:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3c00/0xc3296956897c514e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cf2a expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.871952:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2800/0xc3296956897c5155 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.871966:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2800/0xc3296956897c5155 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.871977:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2800/0xc3296956897c5155 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.872081:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3c00/0xc3296956897c514e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf2a expref: 63 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.872103:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2800/0xc3296956897c5155 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf2a expref: 62 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.872124:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88be88e22300) 00010000:00010000:3.0:1790919142.872127:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790919142.872131:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be813a2800, rc 0) 00000100:00100000:3.0:1790919142.872198:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf78b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+62:11584:x1877914532539520:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 341us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919142.872204:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 220 00000100:00100000:0.0:1790919142.885184:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919142.885304:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532539776 00000100:00100000:3.0:1790919142.885316:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532539776 00000100:00100000:3.0:1790919142.885380:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 221 00000100:00100000:3.0:1790919142.885390:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd827f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+62:11584:x1877914532539776:12345-192.168.201.27@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790919142.885474:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3c00/0xc3296956897c515c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.885491:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3c00/0xc3296956897c515c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.885502:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3c00/0xc3296956897c515c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790919142.885800:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:3.0:1790919142.885811:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 344774283484ns, next at 345774279912ns, rc = 0 00000004:00010000:3.0:1790919142.885884:0:5846:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000756b8839 reply state 000000000421b441 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3c00/0xc3296956897c515c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919142.885893:0:5846:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790919142.886007:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd827f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+64:11584:x1877914532539776:12345-192.168.201.27@tcp:36:lhsmtool_posix.0 Request processed in 618us (832us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1790919142.886034:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 221 00010000:00010000:0.0:1790919142.888276:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3c00/0xc3296956897c515c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.888298:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3c00/0xc3296956897c515c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.888308:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3c00/0xc3296956897c515c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.888335:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be813a3c00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919142.888340:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3c00/0xc3296956897c515c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.888348:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3c00/0xc3296956897c515c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.888364:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88be88e22300) 00010000:00010000:0.0:1790919142.888366:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790919142.888371:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3c00/0xc3296956897c515c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.888378:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3c00/0xc3296956897c515c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919142.888923:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919142.889161:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532539904 00000100:00100000:3.0:1790919142.889172:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532539904 00000100:00100000:3.0:1790919142.889231:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 222 00000100:00100000:3.0:1790919142.889240:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd827f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+63:11584:x1877914532539904:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790919142.889266:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919142.889283:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3200/0xc3296956897c5163 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cf31 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.889338:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3200/0xc3296956897c5163 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf31 expref: 64 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.889351:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3200/0xc3296956897c5163 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf31 expref: 64 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.889369:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88be88e22300) 00010000:00010000:3.0:1790919142.889372:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790919142.889374:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be813a3200, rc 0) 00000100:00100000:3.0:1790919142.889442:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd827f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+64:11584:x1877914532539904:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 202us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919142.889449:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 222 00000100:00100000:1.0:1790919142.898903:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919142.899086:0:10350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532540032 00000100:00100000:0.0:1790919142.899097:0:10350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532540032 00000100:00100000:0.0:1790919142.899164:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 62 00000100:00100000:0.0:1790919142.899174:0:10350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf788000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+9:2352:x1877914532540032:12345-192.168.201.27@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1790919142.899504:0:10350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf788000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+10:2352:x1877914532540032:12345-192.168.201.27@tcp:2:lhsmtool_posix.0 Request processed in 329us (609us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1790919142.899513:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 62 00000100:00100000:1.0:1790919142.903076:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919142.903227:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532540288 00000100:00100000:0.0:1790919142.903238:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532540288 00000100:00100000:0.0:1790919142.903296:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 60 00000100:00100000:0.0:1790919142.903307:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf78a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+64:11584:x1877914532540288:12345-192.168.201.27@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790919142.912641:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf78a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+65:11584:x1877914532540288:12345-192.168.201.27@tcp:35:lhsmtool_posix.0 Request processed in 9321us (9564us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1790919142.912658:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 60 00000100:00100000:1.0:1790919142.927049:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919142.927199:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532540544 00000100:00100000:3.0:1790919142.927210:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532540544 00000100:00100000:3.0:1790919142.927268:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 223 00000100:00100000:3.0:1790919142.927278:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf78aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+65:11584:x1877914532540544:12345-192.168.201.27@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790919142.927406:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf78aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+65:11584:x1877914532540544:12345-192.168.201.27@tcp:57:lhsmtool_posix.0 Request processed in 129us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919142.927429:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 223 00000100:00100000:1.0:1790919142.934619:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919142.934710:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532540672 00000100:00100000:3.0:1790919142.934720:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532540672 00000100:00100000:3.0:1790919142.934789:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 224 00000100:00100000:3.0:1790919142.934800:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba03ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+65:11584:x1877914532540672:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790919142.934825:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919142.934847:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3000/0xc3296956897c516a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cf38 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.934919:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2c00/0xc3296956897c5171 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.934945:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2c00/0xc3296956897c5171 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.934958:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2c00/0xc3296956897c5171 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919142.934994:0:5847:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790919142.935013:0:5847:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2c00/0xc3296956897c5171 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.935038:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3000/0xc3296956897c516a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf38 expref: 67 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.935059:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2c00/0xc3296956897c5171 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf38 expref: 66 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.935068:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88be88e22300) 00010000:00010000:3.0:1790919142.935084:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1790919142.935088:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be813a2c00, rc 0) 00000100:00100000:3.0:1790919142.935154:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba03ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+66:11584:x1877914532540672:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 356us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919142.935162:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 224 00000100:00100000:2.0:1790919142.939327:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919142.939411:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532540800 00000100:00100000:3.0:1790919142.939422:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532540800 00000100:00100000:3.0:1790919142.939480:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 63 00000100:00100000:3.0:1790919142.939490:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba14c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+10:2350:x1877914532540800:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790919142.939508:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919142.939570:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056be3eb3/0xc3296956897c5178 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cf3f expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790919142.939599:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abf41e7, blocks: 0x1 00010000:00010000:3.0:1790919142.939618:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=344s v=(0 0) 00010000:00010000:3.0:1790919142.939623:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919142.939634:0:6699:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056be3eb3/0xc3296956897c5178 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf3f expref: 11 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.939652:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000056be3eb3/0xc3296956897c5178 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf3f expref: 11 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919142.939665:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be813a3a00, rc 0) 00000100:00100000:3.0:1790919142.939912:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba14c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+11:2350:x1877914532540800:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 422us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919142.939920:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 63 00000100:00100000:1.0:1790919142.952465:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919142.952556:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532541056 00000100:00100000:3.0:1790919142.952566:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532541056 00000100:00100000:3.0:1790919142.952621:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 225 00000100:00100000:3.0:1790919142.952630:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf750e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+66:11584:x1877914532541056:12345-192.168.201.27@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790919142.952750:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf750e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+66:11584:x1877914532541056:12345-192.168.201.27@tcp:57:lhsmtool_posix.0 Request processed in 120us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919142.952757:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 225 00000100:00100000:2.0:1790919142.960649:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919142.961009:0:10350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532541184 00000100:00100000:0.0:1790919142.961020:0:10350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532541184 00000100:00100000:0.0:1790919142.961154:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 64 00000100:00100000:0.0:1790919142.961165:0:10350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3c15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+11:11584:x1877914532541184:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790919142.961183:0:10350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919142.961200:0:10350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ccaf95e3/0xc3296956897c517f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cf46 expref: -99 pid: 10350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.961234:0:10350:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000056be3eb3/0xc3296956897c5178 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf3f expref: 12 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.961243:0:10350:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919142.961247:0:10350:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919142.961252:0:10350:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ccaf95e3/0xc3296956897c517f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf46 expref: 12 pid: 10350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.961290:0:10350:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000056be3eb3/0xc3296956897c5178 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf3f expref: 12 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.961303:0:10350:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000056be3eb3/0xc3296956897c5178 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf3f expref: 12 pid: 6699 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919142.961318:0:10350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd827f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10350:1877914550351232:192.168.201.27@tcp:104: 00000100:00100000:0.0:1790919142.961415:0:10350:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be9f8a43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919142.965421:0:10350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd827f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10350:1877914550351232:192.168.201.27@tcp:104: 00010000:00010000:0.0:1790919142.965470:0:10350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ccaf95e3/0xc3296956897c517f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf46 expref: 12 pid: 10350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.965493:0:10350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac59e00, rc 0) 00000100:00100000:0.0:1790919142.965599:0:10350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3c15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+12:11584:x1877914532541184:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 4434us (4958us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919142.965608:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 64 00000100:00100000:1.0:1790919142.967263:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919142.967355:0:8529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532541312 00000100:00100000:0.0:1790919142.967365:0:8529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532541312 00010000:00010000:0.0:1790919142.967404:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000056be3eb3/0xc3296956897c5178 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf3f expref: 12 pid: 6699 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919142.967447:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 82 00000100:00100000:0.0:1790919142.967457:0:8529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf752300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+12:2353:x1877914532541312:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790919142.967472:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919142.967494:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000056be3eb3/0xc3296956897c5178 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf3f expref: 12 pid: 6699 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.967508:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000056be3eb3/0xc3296956897c5178 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf3f expref: 12 pid: 6699 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.967567:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056be3eb3/0xc3296956897c5178 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf3f expref: 12 pid: 6699 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.967586:0:8529:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919142.967598:0:8529:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919142.967607:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ccaf95e3/0xc3296956897c517f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf46 expref: 11 pid: 10350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.967617:0:8529:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ccaf95e3/0xc3296956897c517f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf46 expref: 11 pid: 10350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919142.967654:0:8529:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ccaf95e3/0xc3296956897c517f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf46 expref: 11 pid: 10350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919142.967670:0:8529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd827f1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8529:1877914550351360:192.168.201.27@tcp:105: 00000100:00100000:0.0:1790919142.968252:0:8529:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be9f8a43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790919142.976479:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919142.976557:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532541440 00000100:00100000:2.0:1790919142.976567:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532541440 00002000:00100000:2.0:1790919142.976632:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff88bebf751180 x1877914532541440/t0(0) o4->c4a4e085-55d7-40e9-993c-11b4dfc2d5f5@192.168.201.27@tcp:263/0 lens 504/0 e 0 to 0 dl 1790919153 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790919142.976643:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88bebf751180 with x1877914532541440 ext(0->12) 00002000:00010000:2.0:1790919142.976650:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88bebf751180 00000100:00100000:2.0:1790919142.976691:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 6 00000100:00100000:2.0:1790919142.976701:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf751180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+12:2352:x1877914532541440:12345-192.168.201.27@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1790919142.977164:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf751180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+14:2352:x1877914532541440:12345-192.168.201.27@tcp:4:lhsmtool_posix.0 Request processed in 463us (693us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1790919142.977172:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 6 00002000:00100000:2.0:1790919142.977179:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff88bebf751180 x1877914532541440/t4294967320(0) o4->c4a4e085-55d7-40e9-993c-11b4dfc2d5f5@192.168.201.27@tcp:263/0 lens 504/448 e 0 to 0 dl 1790919153 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790919142.977188:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88bebf751180 with x1877914532541440 ext(0->12) 00002000:00010000:2.0:1790919142.977192:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88bebf751180 00000100:00100000:2.0:1790919142.985069:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919142.989316:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532541568 00000100:00100000:1.0:1790919142.989336:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532541568 00000100:00100000:1.0:1790919142.989417:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 226 00000100:00100000:1.0:1790919142.989427:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba14c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+66:11584:x1877914532541568:12345-192.168.201.27@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1790919142.993077:0:8529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd827f1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8529:1877914550351360:192.168.201.27@tcp:105: 00010000:00010000:0.0:1790919142.993104:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919142.993170:0:8529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf752300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+13:2353:x1877914532541312:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 25712us (25912us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919142.993181:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 82 00000001:00080000:1.0:1790919143.044131:0:5869:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000020:00080000:1.0:1790919143.044287:0:5869:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88be84f6e3c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1790919143.044294:0:5869:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88beba56a500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88be84f6e9c0 00000020:00080000:1.0:1790919143.044297:0:5869:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88beba56a300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88beb4248c00 00000020:00080000:0.0:1790919143.044337:0:5880:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000004:00080000:0.0:1790919143.044461:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000100:00100000:0.0:1790919143.044634:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd827f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550351488:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1790919143.044707:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919143.044777:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550351488 00000100:00100000:0.0:1790919143.044784:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550351488 00000100:00100000:0.0:1790919143.044834:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790919143.044844:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd827f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550351488:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1790919143.044870:0:6699:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:0.0:1790919143.044914:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6abf41e6, atime: 0x6abf41e6, ctime: 0x6abf41e6, blocks: 0xb 00010000:00010000:0.0:1790919143.044923:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073a95e4b/0xc3296956897c5186 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.044952:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=344s v=(0 0) 00010000:00010000:0.0:1790919143.044957:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919143.044964:0:6699:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073a95e4b/0xc3296956897c5186 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.044980:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073a95e4b/0xc3296956897c5186 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.044991:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073a95e4b/0xc3296956897c5186 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.044999:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073a95e4b/0xc3296956897c5186 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.045017:0:6699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:1.0:1790919143.045374:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1790919143.045405:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:1.0:1790919143.045422:0:5869:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88be8e2c6180 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1790919143.045426:0:5869:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88be91c79500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88be8e2c6240 00000020:00080000:1.0:1790919143.045429:0:5869:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88be91c79800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88beb40e7000 00000100:00100000:1.0:1790919143.045539:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf751500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550351616:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1790919143.045577:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1790919143.045608:0:5880:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1790919143.045793:0:5880:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1790919143.045806:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550351616 00000100:00100000:1.0:1790919143.045812:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550351616 00000100:00100000:1.0:1790919143.045849:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790919143.045857:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf752d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1877914550351616:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1790919143.045875:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:1.0:1790919143.045892:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea1c9209/0xc3296956897c518d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919143.045911:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003122c64b/0xc3296956897c4f48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cea5 expref: 12 pid: 10350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919143.045920:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1790919143.045923:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790919143.045939:0:6698:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea1c9209/0xc3296956897c518d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919143.045968:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003122c64b/0xc3296956897c4f48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cea5 expref: 12 pid: 10350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919143.045983:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003122c64b/0xc3296956897c4f48 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cea5 expref: 12 pid: 10350 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919143.045995:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b64700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6698:1877914550351744:192.168.201.27@tcp:104: 00000100:00100000:1.0:1790919143.046077:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be91c84d80 going to sleep for 11 seconds 00000100:00080000:1.0:1790919143.046089:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1790919143.046123:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000100:00100000:0.0:1790919143.046744:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd827f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1877914550351488:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1899us (2034us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1790919143.046753:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790919143.047011:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550351872:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1790919143.047042:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919143.047076:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550351872 00000100:00100000:1.0:1790919143.047080:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550351872 00000100:00100000:1.0:1790919143.047104:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790919143.047109:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3307:x1877914550351872:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1790919143.047292:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1790919143.047296:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1790919143 00002000:00010000:1.0:1790919143.047299:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1790919143.047301:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1790919143 -> 1790919143 00002000:00010000:1.0:1790919143.047303:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1790919143.047330:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3307:x1877914550351872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 221us (287us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1790919143.047336:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:1.0:1790919143.047367:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88beb3b67800/2, rc 0, transno 4294967321 00000100:00100000:1.0:1790919143.047372:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550351872:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1790919143.047389:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:1.0:1790919143.047393:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967309 00000004:00080000:1.0:1790919143.047406:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88beba215880, transno 4294967307 00000004:00080000:1.0:1790919143.047414:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:1.0:1790919143.047429:0:3305:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff88bd827f1880 x1877914550351488/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1790919159 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1790919143.047437:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88bd827f1880/2, rc 0, transno 4294967310 00000100:00100000:1.0:1790919143.047441:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd827f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550351488:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1790919143.047714:0:7650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919143.047723:0:7650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073a95e4b/0xc3296956897c5186 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.047734:0:7650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac58a00 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:0.0:1790919143.047745:0:7650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073a95e4b/0xc3296956897c5186 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.047757:0:7650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073a95e4b/0xc3296956897c5186 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.047777:0:7650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073a95e4b/0xc3296956897c5186 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.047784:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073a95e4b/0xc3296956897c5186 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.047803:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919143.047805:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919143.047807:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919143.049003:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba14c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+20:11584:x1877914532541568:12345-192.168.201.27@tcp:44:lhsmtool_posix.0 Request processed in 59570us (63938us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919143.049015:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 226 00000100:00100000:1.0:1790919143.051567:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b64700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6698:1877914550351744:192.168.201.27@tcp:104: 00010000:00010000:1.0:1790919143.051598:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ea1c9209/0xc3296956897c518d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919143.051819:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919143.051885:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532541696 00000100:00100000:1.0:1790919143.051892:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532541696 00000100:00100000:1.0:1790919143.051995:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 68 00000100:00100000:1.0:1790919143.052004:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba14d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+13:2353:x1877914532541696:12345-192.168.201.27@tcp:16:lhsmtool_posix.0 00000100:00080000:2.0:1790919143.053054:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790919143.053407:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919143.053503:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532541824 00000100:00100000:3.0:1790919143.053510:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532541824 00010000:00010000:3.0:1790919143.053555:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003122c64b/0xc3296956897c4f48 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cea5 expref: 14 pid: 10350 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919143.053595:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 83 00000100:00100000:3.0:1790919143.053604:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+14:2352:x1877914532541824:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919143.053617:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919143.053623:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003122c64b/0xc3296956897c4f48 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cea5 expref: 14 pid: 10350 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919143.053637:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003122c64b/0xc3296956897c4f48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cea5 expref: 14 pid: 10350 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919143.053660:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003122c64b/0xc3296956897c4f48 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cea5 expref: 14 pid: 10350 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919143.053693:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790919143.053697:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790919143.053703:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea1c9209/0xc3296956897c518d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919143.053714:0:5830:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea1c9209/0xc3296956897c518d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919143.053747:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919143.053795:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+13:2352:x1877914532541824:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 192us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919143.053802:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 83 00010000:00010000:2.0:1790919143.054285:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ea1c9209/0xc3296956897c518d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919143.054296:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea1c9209/0xc3296956897c518d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919143.054306:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea1c9209/0xc3296956897c518d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919143.054328:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea1c9209/0xc3296956897c518d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919143.054351:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790919143.054455:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790919143.054463:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea1c9209/0xc3296956897c518d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919143.054472:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88beb3f7e200 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:3.0:1790919143.054476:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea1c9209/0xc3296956897c518d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919143.054485:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea1c9209/0xc3296956897c518d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919143.054498:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea1c9209/0xc3296956897c518d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919143.054516:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea1c9209/0xc3296956897c518d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919143.054563:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919143.054565:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919143.054567:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919143.054958:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf752d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3306:x1877914550351616:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9100us (9378us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1790919143.054968:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:1.0:1790919143.055592:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88bebf751500/2, rc 0, transno 4294967322 00000100:00100000:1.0:1790919143.055601:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf751500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550351616:0@lo:6:osp-syn-0-0.0 00000001:00080000:2.0:1790919143.096016:0:6722:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000001:00080000:2.0:1790919143.096033:0:6722:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:2.0:1790919143.096040:0:6722:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:2.0:1790919143.096048:0:6722:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:1.0:1790919143.096990:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba14d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:2353:x1877914532541696:12345-192.168.201.27@tcp:16:lhsmtool_posix.0 Request processed in 44978us (45163us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919143.097002:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 68 00000100:00100000:1.0:1790919143.104065:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919143.104167:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532542080 00000100:00100000:3.0:1790919143.104178:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532542080 00000100:00100000:3.0:1790919143.104233:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 227 00000100:00100000:3.0:1790919143.104242:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba215880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+20:11584:x1877914532542080:12345-192.168.201.27@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790919143.104295:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919143.104320:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2c00/0xc3296956897c5171 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf38 expref: 20 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919143.104342:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88be88e22300) 00010000:00010000:3.0:1790919143.104347:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790919143.104374:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3000/0xc3296956897c5194 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919143.104388:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3000/0xc3296956897c5194 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919143.104398:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3000/0xc3296956897c5194 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790919143.104700:0:5846:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000009ff6bfb reply state 0000000041fba011 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3000/0xc3296956897c5194 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919143.104730:0:5846:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790919143.104826:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba215880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+21:11584:x1877914532542080:12345-192.168.201.27@tcp:36:lhsmtool_posix.0 Request processed in 585us (771us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1790919143.104834:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 227 00000100:00100000:3.0:1790919143.114468:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919143.114562:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532542208 00000100:00100000:1.0:1790919143.114572:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532542208 00000100:00100000:1.0:1790919143.114623:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 69 00000100:00100000:1.0:1790919143.114634:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:2350:x1877914532542208:12345-192.168.201.27@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1790919143.114847:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1790919143.114852:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1790919143 -> 1790919142 00002000:00010000:1.0:1790919143.114854:0:6699:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1790919142 00002000:00010000:1.0:1790919143.114857:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1790919143 -> 1790919142 00002000:00010000:1.0:1790919143.114859:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1790919143.114936:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+8:2350:x1877914532542208:12345-192.168.201.27@tcp:2:lhsmtool_posix.0 Request processed in 297us (471us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1790919143.114959:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 69 00010000:00010000:0.0:1790919143.115913:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3000/0xc3296956897c5194 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.115937:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3000/0xc3296956897c5194 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.115947:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3000/0xc3296956897c5194 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.115954:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be813a3000 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919143.115958:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3000/0xc3296956897c5194 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.115966:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3000/0xc3296956897c5194 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.116000:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88be88e22300) 00010000:00010000:0.0:1790919143.116003:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919143.116008:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3000/0xc3296956897c5194 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.116014:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3000/0xc3296956897c5194 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919143.116944:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919143.117248:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532542464 00000100:00100000:2.0:1790919143.117258:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532542464 00000100:00100000:2.0:1790919143.117317:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 228 00000100:00100000:2.0:1790919143.117328:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+20:11584:x1877914532542464:12345-192.168.201.27@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1790919143.117397:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e600/0xc3296956897c519b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919143.117412:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2800/0xc3296956897c5155 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf2a expref: 20 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919143.117421:0:5845:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e600/0xc3296956897c519b lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919143.117456:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2800/0xc3296956897c5155 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf2a expref: 20 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919143.117485:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2800/0xc3296956897c5155 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf2a expref: 20 pid: 5847 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919143.117500:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beba14e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1877914550352000:192.168.201.27@tcp:104: 00000100:00100000:2.0:1790919143.117621:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be903073c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790919143.123752:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919143.123842:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532542592 00000100:00100000:3.0:1790919143.123854:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532542592 00010000:00010000:3.0:1790919143.123897:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2800/0xc3296956897c5155 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf2a expref: 21 pid: 5847 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919143.123951:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 84 00000100:00100000:3.0:1790919143.123962:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba14c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+21:2353:x1877914532542592:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919143.123978:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919143.123986:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2800/0xc3296956897c5155 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf2a expref: 21 pid: 5847 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919143.124000:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2800/0xc3296956897c5155 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf2a expref: 21 pid: 5847 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919143.124023:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88be88e22300) 00010000:00010000:3.0:1790919143.124086:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e600/0xc3296956897c519b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919143.124099:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e600/0xc3296956897c519b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919143.124128:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e600/0xc3296956897c519b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919143.124150:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919143.124206:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba14c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+21:2353:x1877914532542592:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 245us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919143.124213:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 84 00010000:00010000:0.0:1790919143.124383:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2800/0xc3296956897c5155 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf2a expref: 20 pid: 5847 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919143.124403:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beba14e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1877914550352000:192.168.201.27@tcp:104: 00010000:00010000:0.0:1790919143.124427:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e600/0xc3296956897c519b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.124437:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e600/0xc3296956897c519b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.124444:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e600/0xc3296956897c519b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.124473:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e600/0xc3296956897c519b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.124481:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e600/0xc3296956897c519b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.124488:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e600/0xc3296956897c519b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.124506:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be90f9e600 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919143.124510:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e600/0xc3296956897c519b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.124518:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e600/0xc3296956897c519b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.124552:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88be88e22300) 00010000:00010000:0.0:1790919143.124556:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1790919143.124560:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e600/0xc3296956897c519b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.124566:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e600/0xc3296956897c519b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919143.124622:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+19:11584:x1877914532542464:12345-192.168.201.27@tcp:55:lhsmtool_posix.0 Request processed in 7292us (7691us total) trans 0 rc -22/-22 00000100:00100000:0.0:1790919143.124630:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 228 00000100:00100000:0.0:1790919143.129098:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919143.129219:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532542720 00000100:00100000:2.0:1790919143.129230:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532542720 00000100:00100000:2.0:1790919143.129343:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 70 00000100:00100000:2.0:1790919143.129354:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd827f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+8:2351:x1877914532542720:12345-192.168.201.27@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1790919143.129399:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007d395909/0xc3296956897c51a2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919143.129420:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ccaf95e3/0xc3296956897c517f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf46 expref: 8 pid: 10350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919143.129429:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1790919143.129433:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790919143.129438:0:6698:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d395909/0xc3296956897c51a2 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919143.129474:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ccaf95e3/0xc3296956897c517f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf46 expref: 8 pid: 10350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919143.129489:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ccaf95e3/0xc3296956897c517f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf46 expref: 8 pid: 10350 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919143.129517:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beba14ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6698:1877914550352128:192.168.201.27@tcp:104: 00000100:00100000:2.0:1790919143.129651:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be903070c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790919143.139442:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919143.139484:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532542848 00000100:00100000:2.0:1790919143.139493:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532542848 00010000:00010000:2.0:1790919143.139552:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ccaf95e3/0xc3296956897c517f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf46 expref: 9 pid: 10350 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919143.139599:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 85 00000100:00100000:2.0:1790919143.139609:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba14dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+9:2353:x1877914532542848:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790919143.139626:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919143.139649:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ccaf95e3/0xc3296956897c517f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf46 expref: 9 pid: 10350 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919143.139663:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ccaf95e3/0xc3296956897c517f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf46 expref: 9 pid: 10350 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919143.139690:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790919143.139695:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790919143.139700:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007d395909/0xc3296956897c51a2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919143.139710:0:5830:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d395909/0xc3296956897c51a2 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919143.139749:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919143.139800:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba14dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+9:2353:x1877914532542848:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 192us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919143.139808:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 85 00010000:00010000:0.0:1790919143.140043:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ccaf95e3/0xc3296956897c517f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf46 expref: 8 pid: 10350 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919143.140058:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beba14ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6698:1877914550352128:192.168.201.27@tcp:104: 00010000:00010000:0.0:1790919143.140078:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007d395909/0xc3296956897c51a2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.140089:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007d395909/0xc3296956897c51a2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.140103:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d395909/0xc3296956897c51a2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.140129:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007d395909/0xc3296956897c51a2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.140137:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d395909/0xc3296956897c51a2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.140144:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d395909/0xc3296956897c51a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.140150:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be90f9e400 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:0.0:1790919143.140154:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d395909/0xc3296956897c51a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.140162:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d395909/0xc3296956897c51a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.140175:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d395909/0xc3296956897c51a2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.140182:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d395909/0xc3296956897c51a2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919143.140240:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd827f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:2351:x1877914532542720:12345-192.168.201.27@tcp:1:lhsmtool_posix.0 Request processed in 10888us (11152us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919143.140248:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 70 00000100:00100000:2.0:1790919143.143270:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919143.143406:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532543104 00000100:00100000:3.0:1790919143.143416:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532543104 00000100:00100000:3.0:1790919143.143480:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 229 00000100:00100000:3.0:1790919143.143489:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba14ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+19:11584:x1877914532543104:12345-192.168.201.27@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1790919143.144714:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2c00/0xc3296956897c51a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919143.144735:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2c00/0xc3296956897c51a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919143.144749:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2c00/0xc3296956897c51a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919143.144981:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2400/0xc3296956897c51b0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919143.144995:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3200/0xc3296956897c5163 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf31 expref: 20 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919143.145004:0:5846:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2400/0xc3296956897c51b0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919143.145053:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3200/0xc3296956897c5163 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf31 expref: 20 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919143.145070:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3200/0xc3296956897c5163 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf31 expref: 20 pid: 5847 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919143.145084:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877914550352256:192.168.201.27@tcp:104: 00000100:00100000:3.0:1790919143.145170:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be812549c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790919143.148182:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877914550352256:192.168.201.27@tcp:104: 00010000:00010000:3.0:1790919143.148211:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2400/0xc3296956897c51b0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919143.149131:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919143.149237:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532543232 00000100:00100000:3.0:1790919143.149246:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532543232 00010000:00010000:3.0:1790919143.149285:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3200/0xc3296956897c5163 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf31 expref: 21 pid: 5847 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919143.149323:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 86 00000100:00100000:3.0:1790919143.149333:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba14e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+21:2353:x1877914532543232:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919143.149347:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919143.149352:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3200/0xc3296956897c5163 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf31 expref: 21 pid: 5847 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919143.149363:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3200/0xc3296956897c5163 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf31 expref: 21 pid: 5847 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919143.149405:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3200/0xc3296956897c5163 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf31 expref: 21 pid: 5847 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919143.149423:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88be88e22300) 00010000:00010000:3.0:1790919143.149428:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2400/0xc3296956897c51b0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919143.149436:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2400/0xc3296956897c51b0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919143.149444:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2400/0xc3296956897c51b0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919143.149520:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919143.149610:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba14e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+20:2353:x1877914532543232:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 278us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919143.149618:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 86 00010000:00010000:0.0:1790919143.157875:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2400/0xc3296956897c51b0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.157892:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2400/0xc3296956897c51b0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790919143.158064:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:0.0:1790919143.158205:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1790919143.158248:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:0.0:1790919143.158336:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bd827f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1877914550352384:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1790919143.158403:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919143.158642:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be9f8a4840 going to sleep for 11 seconds 00000100:00100000:3.0:1790919143.163322:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550352384 00000100:00100000:3.0:1790919143.163340:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550352384 00000100:00100000:2.0:1790919143.163572:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790919143.163825:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd827f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5846:x1877914550352384:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1790919143.163966:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd827f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5846:x1877914550352384:12345-0@lo:1000:mdt00_001.0 Request processed in 384us (5563us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919143.163975:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790919143.164063:0:5846:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:3.0:1790919143.164070:0:5846:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:3.0:1790919143.164092:0:5846:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88beb3b67800, transno 4294967321 00000100:00100000:3.0:1790919143.164113:0:5846:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff88bebf751500 x1877914550351616/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1790919159 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919143.164127:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bd827f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1877914550352384:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1790919143.164625:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1790919143.164703:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1877914550352512:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1790919143.164751:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919143.165319:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be88d44c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790919143.165389:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550352512 00000100:00100000:0.0:1790919143.165397:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550352512 00000100:00100000:0.0:1790919143.165429:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790919143.165436:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5846:x1877914550352512:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1790919143.165717:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5846:x1877914550352512:12345-0@lo:1000:mdt00_001.0 Request processed in 280us (964us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1790919143.165724:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790919143.165878:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1877914550352512:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1790919143.165912:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2400/0xc3296956897c51b0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919143.165923:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2400/0xc3296956897c51b0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919143.165942:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2400/0xc3296956897c51b0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919143.165948:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be813a2400 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919143.165952:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2400/0xc3296956897c51b0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919143.165959:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2400/0xc3296956897c51b0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919143.165975:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88be88e22300) 00010000:00010000:3.0:1790919143.165978:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790919143.165982:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2400/0xc3296956897c51b0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919143.165989:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2400/0xc3296956897c51b0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919143.166024:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c50f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919143.166030:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c50f3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919143.166047:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c50f3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919143.166052:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81673800 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919143.166055:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c50f3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919143.166061:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c50f3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919143.166069:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88be853b5800) 00010000:00010000:3.0:1790919143.166072:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790919143.166078:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c50fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf15 expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919143.166089:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c50fa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf15 expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919143.166097:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c50fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf15 expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919143.166125:0:5846:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c50fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf15 expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919143.166138:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877914550352640:192.168.201.27@tcp:105: 00000100:00100000:3.0:1790919143.166210:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be88d44c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790919143.170680:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550352768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790919143.170758:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919143.170924:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550352768 00000100:00100000:3.0:1790919143.170943:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550352768 00000100:00100000:3.0:1790919143.171008:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790919143.171017:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd827f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1877914550352768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790919143.171040:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1790919143.171081:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd827f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1877914550352768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919143.171088:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790919143.172228:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550352768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790919143.172562:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919143.173741:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877914550352640:192.168.201.27@tcp:105: 00010000:00010000:0.0:1790919143.173782:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c50f3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.173792:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673800/0xc3296956897c50f3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.173824:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c51b7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.173838:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c51b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.173848:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c51b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.173857:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c51b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.173863:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c51b7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.173869:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c51b7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.173874:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac58c00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919143.173878:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c51b7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.173885:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c51b7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.173895:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88be853b5800) 00010000:00010000:0.0:1790919143.173898:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919143.173907:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c51b7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.173913:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58c00/0xc3296956897c51b7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.173924:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2c00/0xc3296956897c51a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.173939:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2c00/0xc3296956897c51a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.173945:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2c00/0xc3296956897c51a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.173951:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be813a2c00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919143.173954:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2c00/0xc3296956897c51a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.173959:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2c00/0xc3296956897c51a9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.173967:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88be853b5800) 00010000:00010000:0.0:1790919143.173969:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790919143.173972:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2c00/0xc3296956897c51a9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.173977:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2c00/0xc3296956897c51a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919143.174203:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba14ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+23:11584:x1877914532543104:12345-192.168.201.27@tcp:57:lhsmtool_posix.0 Request processed in 30714us (30943us total) trans 4294967512 rc 0/0 00000100:00100000:0.0:1790919143.174215:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 229 00000020:00080000:0.0:1790919143.174226:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1790919143.174392:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790919143.174398:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790919143.174898:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1790919143.174906:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790919143.176995:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919143.177066:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532543360 00000100:00100000:2.0:1790919143.177077:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532543360 00000100:00100000:2.0:1790919143.177116:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532543616 00000100:00100000:2.0:1790919143.177119:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532543616 00000100:00100000:2.0:1790919143.177133:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 61 00000100:00100000:2.0:1790919143.177142:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+24:11583:x1877914532543360:12345-192.168.201.27@tcp:49:lfs.0 00000100:00100000:2.0:1790919143.177284:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+24:11583:x1877914532543360:12345-192.168.201.27@tcp:49:lfs.0 Request processed in 142us (4723us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919143.177292:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 61 00000100:00100000:2.0:1790919143.177310:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 62 00000100:00100000:2.0:1790919143.177332:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be928c4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+23:11584:x1877914532543616:12345-192.168.201.27@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1790919143.178023:0:5849:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1790919143.178115:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:2.0:1790919143.178156:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e800/0xc3296956897c51be lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919143.178173:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e800/0xc3296956897c51be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919143.178184:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e800/0xc3296956897c51be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919143.178192:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e800/0xc3296956897c51be lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919143.178199:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e800/0xc3296956897c51be lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919143.178204:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e800/0xc3296956897c51be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919143.178229:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790919143.178280:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be928c4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+25:11584:x1877914532543616:12345-192.168.201.27@tcp:35:lhsmtool_posix.0 Request processed in 947us (1292us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1790919143.178287:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 62 00000020:00080000:2.0:1790919143.178291:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790919143.178426:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919143.178434:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e800/0xc3296956897c51be lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.178440:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be90f9e800 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:0.0:1790919143.178444:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e800/0xc3296956897c51be lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.178452:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e800/0xc3296956897c51be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.178465:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88be85efc500) 00010000:00010000:0.0:1790919143.178468:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790919143.178472:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e800/0xc3296956897c51be lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.178478:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e800/0xc3296956897c51be lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919143.178495:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919143.178497:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919143.178499:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919143.182786:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919143.184870:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532543872 00000100:00100000:1.0:1790919143.184889:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532543872 00000100:00100000:0.0:1790919143.188300:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 230 00000100:00100000:0.0:1790919143.188316:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+25:11583:x1877914532543872:12345-192.168.201.27@tcp:58:lfs.0 00000040:00080000:0.0:1790919143.188632:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1790919143.188730:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+25:11583:x1877914532543872:12345-192.168.201.27@tcp:58:lfs.0 Request processed in 417us (5953us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919143.188737:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 230 00000100:00100000:3.0:1790919143.256748:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919143.256987:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532544000 00000100:00100000:1.0:1790919143.256999:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532544000 00000100:00100000:1.0:1790919143.257063:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 231 00000100:00100000:1.0:1790919143.257072:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+25:11586:x1877914532544000:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:1.0:1790919143.257096:0:8231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919143.257115:0:8231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e400/0xc3296956897c51c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cf4d expref: -99 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919143.257190:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ec00/0xc3296956897c51cc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919143.257205:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ec00/0xc3296956897c51cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919143.257217:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ec00/0xc3296956897c51cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919143.257231:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c51d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919143.257237:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c51d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919143.257243:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c51d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919143.257494:0:8231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c51da lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919143.257513:0:8231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c50e5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf0e expref: 26 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919143.257522:0:8231:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c51da lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919143.257603:0:8231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c50e5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf0e expref: 26 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919143.257617:0:8231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c50e5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf0e expref: 26 pid: 8231 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919143.257632:0:8231:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beba217100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8231:1877914550352896:192.168.201.27@tcp:104: 00000100:00100000:1.0:1790919143.257733:0:8231:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be91c84a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790919143.263781:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919143.263997:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532544256 00000100:00100000:2.0:1790919143.264007:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532544256 00000100:00100000:2.0:1790919143.264073:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 63 00000100:00100000:2.0:1790919143.264084:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba216a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+27:6048:x1877914532544256:12345-192.168.201.27@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1790919143.264365:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba216a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+28:6048:x1877914532544256:12345-192.168.201.27@tcp:35:ldlm_bl.0 Request processed in 282us (591us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1790919143.264373:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 63 00000100:00100000:0.0:1790919143.265122:0:8231:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beba217100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8231:1877914550352896:192.168.201.27@tcp:104: 00010000:00010000:0.0:1790919143.265161:0:8231:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c51da lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919143.266904:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919143.267609:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532544384 00000100:00100000:2.0:1790919143.267620:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532544384 00010000:00010000:2.0:1790919143.267664:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c50e5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf0e expref: 28 pid: 8231 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919143.267712:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 87 00000100:00100000:2.0:1790919143.267723:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be924bd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+28:2352:x1877914532544384:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790919143.267741:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919143.267748:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c50e5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf0e expref: 28 pid: 8231 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919143.267763:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c50e5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf0e expref: 28 pid: 8231 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919143.267787:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59a00/0xc3296956897c50e5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf0e expref: 28 pid: 8231 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919143.267807:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88be853b5800) 00010000:00010000:2.0:1790919143.267812:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c51da lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919143.267822:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c51da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919143.267835:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c51da lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919143.267890:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919143.267966:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be924bd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+27:2352:x1877914532544384:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 243us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919143.267973:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 87 00010000:00010000:1.0:1790919143.270595:0:8231:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c51da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919143.270613:0:8231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c51da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790919143.270660:0:8231:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1790919143.270665:0:8231:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790919143.270697:0:8231:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c51da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919143.270713:0:8231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c51da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919143.270743:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ec00/0xc3296956897c51cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919143.270751:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ec00/0xc3296956897c51cc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919143.270758:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ec00/0xc3296956897c51cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919143.270764:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88beb3f7ec00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:1.0:1790919143.270769:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ec00/0xc3296956897c51cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919143.270777:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ec00/0xc3296956897c51cc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919143.270791:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88be85efcd00) 00010000:00010000:1.0:1790919143.270793:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919143.270798:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ec00/0xc3296956897c51cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919143.270805:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ec00/0xc3296956897c51cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919143.270822:0:8231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c51d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919143.270829:0:8231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c51d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919143.270834:0:8231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c51d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919143.270844:0:8231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88beb3f7e800 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:1.0:1790919143.270847:0:8231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c51d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919143.270853:0:8231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c51d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919143.270861:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88be8b621a00) 00010000:00010000:1.0:1790919143.270863:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919143.270866:0:8231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c51d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919143.270872:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e800/0xc3296956897c51d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919143.270917:0:8231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e400/0xc3296956897c51c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf4d expref: 27 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919143.270942:0:8231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c51da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf4d expref: 26 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919143.270949:0:8231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88be853b5800) 00010000:00010000:1.0:1790919143.270952:0:8231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790919143.270954:0:8231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88beb3f7e600, rc 0) 00000100:00100000:1.0:1790919143.271033:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+26:11586:x1877914532544000:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 13961us (14294us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919143.271051:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 231 00010000:00010000:3.0:1790919143.689716:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790919144.066175:0:12584:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790919144.066188:0:12584:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790919144.066240:0:12584:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1790919144.066245:0:12584:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790919144.148174:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919144.148218:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919144.148248:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919144.148266:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919144.148296:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919144.148340:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532544896 00000100:00100000:1.0:1790919144.148349:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532544896 00000100:00100000:1.0:1790919144.148401:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532544768 00000100:00100000:1.0:1790919144.148403:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532544768 00000100:00100000:1.0:1790919144.148424:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 90 00000100:00100000:1.0:1790919144.148433:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba217800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2353:x1877914532544896:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:1.0:1790919144.148504:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba217800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2353:x1877914532544896:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 72us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919144.148512:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 90 00000100:00100000:1.0:1790919144.148548:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 91 00000100:00100000:1.0:1790919144.148555:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba214000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:2353:x1877914532544768:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:1.0:1790919144.148580:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba214000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:2353:x1877914532544768:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 26us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919144.148587:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 91 00000100:00100000:1.0:1790919144.148605:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532544512 00000100:00100000:1.0:1790919144.148608:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532544512 00000100:00100000:1.0:1790919144.148631:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 297 00000100:00100000:2.0:1790919144.148724:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532544640 00000100:00100000:2.0:1790919144.148729:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532544640 00000100:00100000:2.0:1790919144.148760:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532545024 00000100:00100000:2.0:1790919144.148764:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532545024 00000100:00100000:2.0:1790919144.148785:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 155 00000100:00100000:2.0:1790919144.148791:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba214700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+26:2353:x1877914532544640:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:2.0:1790919144.148824:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba214700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+26:2353:x1877914532544640:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 34us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919144.148831:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 155 00000100:00100000:2.0:1790919144.148844:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 156 00000100:00100000:2.0:1790919144.148850:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba217b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5591729f-44f1-43f1-b042-c3a508737d97+5:2353:x1877914532545024:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:2.0:1790919144.148871:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba217b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5591729f-44f1-43f1-b042-c3a508737d97+5:2353:x1877914532545024:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 21us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919144.148877:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 156 00000100:00100000:1.0:1790919144.148929:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+13:2353:x1877914532544512:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:1.0:1790919144.148955:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+13:2353:x1877914532544512:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 32us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919144.148975:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 297 00000100:00080000:1.0:1790919144.149007:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790919144.149012:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1790919144.192977:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790919144.192990:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790919144.193890:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1790919144.193900:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790919144.194229:0:11708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beba026d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11708:1877914550353024:192.168.201.27@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790919144.195096:0:11708:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be868eee40 going to sleep for 11 seconds 00000100:00100000:1.0:1790919144.202646:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919144.202688:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532545152 00000100:00100000:1.0:1790919144.202699:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532545152 00000100:00100000:1.0:1790919144.202763:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 232 00000100:00100000:1.0:1790919144.202773:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba215500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+27:11598:x1877914532545152:12345-192.168.201.27@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790919144.202814:0:5845:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790919144.202934:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba215500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+27:11598:x1877914532545152:12345-192.168.201.27@tcp:53:lhsmtool_posix.0 Request processed in 162us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919144.202943:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 232 00000100:00100000:3.0:1790919144.204405:0:11708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beba026d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11708:1877914550353024:192.168.201.27@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790919144.205266:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919144.209455:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532545408 00000100:00100000:1.0:1790919144.209471:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532545408 00000100:00100000:1.0:1790919144.209549:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 233 00000100:00100000:1.0:1790919144.209560:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+26:11598:x1877914532545408:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790919144.209585:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919144.209609:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f800/0xc3296956897c51e1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cf54 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919144.209886:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c51e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919144.209902:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c51e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919144.209930:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c51e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790919144.209962:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1790919144.210184:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f800/0xc3296956897c51e1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf54 expref: 29 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919144.210207:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c51e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf54 expref: 28 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919144.210215:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88be853b5800) 00010000:00010000:1.0:1790919144.210218:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790919144.210222:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88beb3f7e200, rc 0) 00000100:00100000:1.0:1790919144.210346:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+28:11598:x1877914532545408:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 788us (5083us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1790919144.210354:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 233 00000100:00100000:0.0:1790919144.218585:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919144.218625:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919144.218672:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532545792 00000100:00100000:0.0:1790919144.218682:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532545792 00000100:00100000:0.0:1790919144.218743:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 17 00000100:00100000:0.0:1790919144.218753:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba026d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+28:2350:x1877914532545792:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790919144.218771:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919144.218797:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e200/0xc3296956897c51e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf54 expref: 28 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919144.218821:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88be853b5800) 00010000:00010000:0.0:1790919144.218827:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919144.218877:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba026d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+27:2350:x1877914532545792:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 125us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919144.218884:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 17 00000100:00100000:3.0:1790919144.219819:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532545664 00000100:00100000:3.0:1790919144.219828:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532545664 00000100:00100000:3.0:1790919144.219873:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 234 00000100:00100000:3.0:1790919144.219881:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+27:11598:x1877914532545664:12345-192.168.201.27@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1790919144.219961:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2400/0xc3296956897c51f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919144.219977:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2400/0xc3296956897c51f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919144.219987:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2400/0xc3296956897c51f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919144.220190:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2400/0xc3296956897c51f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919144.220213:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2400/0xc3296956897c51f6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919144.220219:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2400/0xc3296956897c51f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919144.220225:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be813a2400 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919144.220229:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2400/0xc3296956897c51f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919144.220237:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2400/0xc3296956897c51f6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919144.220247:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88be853b5800) 00010000:00010000:3.0:1790919144.220250:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790919144.220255:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2400/0xc3296956897c51f6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919144.220260:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2400/0xc3296956897c51f6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919144.220391:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+28:11598:x1877914532545664:12345-192.168.201.27@tcp:57:lhsmtool_posix.0 Request processed in 511us (1817us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1790919144.220400:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 234 00000040:00080000:3.0:1790919144.221902:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790919144.221917:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790919144.224887:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1790919144.224904:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790919144.225367:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919144.225851:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532546048 00000100:00100000:3.0:1790919144.225862:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532546048 00000100:00100000:3.0:1790919144.225938:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 64 00000100:00100000:3.0:1790919144.225949:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+28:11598:x1877914532546048:12345-192.168.201.27@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790919144.226981:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+29:11598:x1877914532546048:12345-192.168.201.27@tcp:35:lhsmtool_posix.0 Request processed in 1027us (1613us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1790919144.226992:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 64 00010000:00010000:1.0:1790919144.704459:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919145.727667:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919145.727855:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beba14fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550353536:0@lo:400:kworker.0 00000100:00100000:2.0:1790919145.727933:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919145.727982:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790919145.727986:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beba14e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1877914550353408:0@lo:400:kworker.0 00000100:00100000:2.0:1790919145.728017:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919145.728040:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550353536 00000100:00100000:2.0:1790919145.728046:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550353536 00000100:00100000:2.0:1790919145.728092:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1790919145.728099:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be83438700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1877914550353536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919145.728139:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be83438700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1877914550353536:12345-0@lo:400:kworker.0 Request processed in 42us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919145.728144:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1790919145.728166:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550353408 00000100:00100000:2.0:1790919145.728170:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550353408 00000100:00100000:2.0:1790919145.728195:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1790919145.728202:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be83439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877914550353408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919145.728229:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be83439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877914550353408:12345-0@lo:400:kworker.0 Request processed in 29us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919145.728233:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:2.0:1790919145.728245:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790919145.728248:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790919145.728272:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beba14e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1877914550353408:0@lo:400:kworker.0 00000100:00100000:2.0:1790919145.728278:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beba14fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550353536:0@lo:400:kworker.0 00000100:00100000:1.0:1790919145.728663:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beba14c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550353152:0@lo:400:kworker.0 00000100:00100000:1.0:1790919145.728699:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919145.728732:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1877914550353664:0@lo:400:kworker.0 00000100:00100000:1.0:1790919145.728755:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919145.728773:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1790919145.728778:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beba14dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877914550353280:0@lo:400:kworker.0 00000100:00100000:1.0:1790919145.728799:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919145.728813:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf752300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550353792:0@lo:400:kworker.0 00000100:00100000:1.0:1790919145.728833:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919145.728858:0:6698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550353792 00000100:00100000:1.0:1790919145.728862:0:6698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550353792 00000100:00100000:1.0:1790919145.728914:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790919145.728920:0:6698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1877914550353792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919145.728958:0:6698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1877914550353792:12345-0@lo:400:kworker.0 Request processed in 38us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919145.728964:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790919145.728992:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf752300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550353792:0@lo:400:kworker.0 00000100:00100000:0.0:1790919145.729075:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550353664 00000100:00100000:0.0:1790919145.729080:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550353664 00000100:00100000:0.0:1790919145.729112:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550353280 00000100:00100000:0.0:1790919145.729116:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550353280 00000100:00100000:0.0:1790919145.729135:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1790919145.729141:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba217100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877914550353664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919145.729181:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba217100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877914550353664:12345-0@lo:400:kworker.0 Request processed in 40us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919145.729187:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1790919145.729200:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1790919145.729206:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877914550353280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919145.729235:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877914550353280:12345-0@lo:400:kworker.0 Request processed in 30us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919145.729240:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1790919145.729264:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beba14dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877914550353280:0@lo:400:kworker.0 00000100:00100000:0.0:1790919145.729273:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1877914550353664:0@lo:400:kworker.0 00000100:00100000:2.0:1790919145.729359:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550353152 00000100:00100000:2.0:1790919145.729363:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550353152 00000100:00100000:2.0:1790919145.729397:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1790919145.729405:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3305:x1877914550353152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919145.729444:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3305:x1877914550353152:12345-0@lo:400:kworker.0 Request processed in 40us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919145.729450:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00080000:2.0:1790919145.729478:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790919145.729482:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790919145.729496:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beba14c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550353152:0@lo:400:kworker.0 00000040:00080000:1.0:1790919145.947127:0:12636:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790919145.947138:0:12636:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790919145.947192:0:12636:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1790919145.947198:0:12636:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790919146.119460:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919146.120967:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532546304 00000100:00100000:0.0:1790919146.120978:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532546304 00000100:00080000:3.0:1790919146.121231:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790919146.121571:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 235 00000100:00100000:0.0:1790919146.121589:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+29:11619:x1877914532546304:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:0.0:1790919146.121616:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919146.121642:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c51fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cf5b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919146.121748:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c5204 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919146.121780:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c5204 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919146.121793:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c5204 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919146.121817:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1790919146.121951:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58000/0xc3296956897c51fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf5b expref: 32 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919146.121973:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c5204 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf5b expref: 31 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919146.121982:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88be853b5800) 00010000:00010000:0.0:1790919146.121985:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1790919146.121989:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac59400, rc 0) 00000100:00100000:0.0:1790919146.123399:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+31:11619:x1877914532546304:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 1807us (3941us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1790919146.123412:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 235 00000100:00100000:1.0:1790919146.139285:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919146.139357:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532546432 00000100:00100000:2.0:1790919146.139367:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532546432 00000100:00100000:2.0:1790919146.143476:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 236 00000100:00100000:2.0:1790919146.143500:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf752300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+31:11619:x1877914532546432:12345-192.168.201.27@tcp:54:lfs.0 00010000:00010000:2.0:1790919146.143589:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c5212 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919146.143606:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c5212 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919146.143629:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c5212 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919146.143655:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c5212 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919146.143663:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c5212 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919146.143671:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c5212 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919146.143677:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be90f9ee00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919146.143683:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c5212 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919146.143690:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c5212 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919146.143701:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88be853b5800) 00010000:00010000:2.0:1790919146.143704:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790919146.143719:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c5212 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919146.143726:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c5212 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919146.143810:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf752300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+31:11619:x1877914532546432:12345-192.168.201.27@tcp:54:lfs.0 Request processed in 320us (4533us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919146.143818:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 236 00000100:00100000:2.0:1790919146.241278:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790919146.241302:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550353920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790919146.241373:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919146.241776:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550353920 00000100:00100000:0.0:1790919146.241786:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550353920 00000100:00100000:0.0:1790919146.241838:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790919146.241848:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba14c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1877914550353920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790919146.241893:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790919146.241942:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba14c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1877914550353920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919146.241948:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790919146.242743:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550353920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790919146.251947:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919146.252020:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532546560 00000100:00100000:1.0:1790919146.252032:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532546560 00000100:00100000:1.0:1790919146.252168:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 71 00000100:00100000:1.0:1790919146.252179:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:2353:x1877914532546560:12345-192.168.201.27@tcp:101:cat.0 00010000:00010000:1.0:1790919146.252198:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919146.252220:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039733a50/0xc3296956897c5219 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cf62 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790919146.252246:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6abf41e6, atime: 0x6abf41e6, ctime: 0x6abf41e6, blocks: 0xb 00010000:00010000:1.0:1790919146.252265:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=348s v=(0 0) 00010000:00010000:1.0:1790919146.252269:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919146.252279:0:6699:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039733a50/0xc3296956897c5219 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf62 expref: 8 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919146.252298:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000039733a50/0xc3296956897c5219 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf62 expref: 8 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1790919146.252331:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790919146.252334:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88beb3f7f600, rc 0) 00000100:00100000:1.0:1790919146.252404:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+8:2353:x1877914532546560:12345-192.168.201.27@tcp:101:cat.0 Request processed in 227us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919146.252411:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 71 00000100:00100000:3.0:1790919146.259399:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919146.259470:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532546688 00000100:00100000:1.0:1790919146.259484:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532546688 00002000:00100000:1.0:1790919146.259560:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff88beb3b15500 x1877914532546688/t0(0) o3->c4a4e085-55d7-40e9-993c-11b4dfc2d5f5@192.168.201.27@tcp:267/0 lens 488/0 e 0 to 0 dl 1790919157 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790919146.259572:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88beb3b15500 with x1877914532546688 ext(0->4095) 00002000:00010000:1.0:1790919146.259578:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88beb3b15500 00000100:00100000:2.0:1790919146.259894:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 7 00000100:00100000:2.0:1790919146.259910:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+8:2352:x1877914532546688:12345-192.168.201.27@tcp:3:cat.0 00000100:00100000:2.0:1790919146.260494:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+8:2352:x1877914532546688:12345-192.168.201.27@tcp:3:cat.0 Request processed in 586us (1100us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1790919146.260502:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 7 00002000:00100000:2.0:1790919146.260511:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff88beb3b15500 x1877914532546688/t0(0) o3->c4a4e085-55d7-40e9-993c-11b4dfc2d5f5@192.168.201.27@tcp:267/0 lens 488/4536 e 0 to 0 dl 1790919157 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790919146.260519:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88beb3b15500 with x1877914532546688 ext(0->4095) 00002000:00010000:2.0:1790919146.260553:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88beb3b15500 00010000:00010000:3.0:1790919146.752273:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1790919147.345326:0:7662:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00010000:00010000:1.0:1790919147.782624:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919148.291919:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf6e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550354048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790919148.291997:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919148.292071:0:11721:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550354048 00000100:00100000:1.0:1790919148.292080:0:11721:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550354048 00000100:00100000:1.0:1790919148.292134:0:11721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790919148.292145:0:11721:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1877914550354048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790919148.292184:0:11721:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919148.292230:0:11721:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1877914550354048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (233us total) trans 0 rc 0/0 00000100:00080000:3.0:1790919148.292236:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790919148.292238:0:11721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790919148.292284:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf6e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550354048:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1790919148.352657:0:6722:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:3.0:1790919148.352670:0:6722:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:1.0:1790919148.366309:0:5869:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:1.0:1790919148.366337:0:5869:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1790919148.366384:0:5869:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88be81254600 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1790919148.366389:0:5869:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88be91cc7400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88be812549c0 00000020:00080000:1.0:1790919148.366393:0:5869:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88be91cc7800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88beba747800 00000020:00080000:2.0:1790919148.366433:0:5880:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1790919148.366750:0:5880:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:0.0:1790919148.799960:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919149.268911:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919149.268951:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919149.268983:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919149.269002:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919149.269027:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919149.269055:0:10350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532547200 00000100:00100000:3.0:1790919149.269065:0:10350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532547200 00000100:00100000:3.0:1790919149.269128:0:10350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532547072 00000100:00100000:3.0:1790919149.269132:0:10350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532547072 00000100:00100000:3.0:1790919149.269154:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 94 00000100:00100000:3.0:1790919149.269166:0:10350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2352:x1877914532547200:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1790919149.269250:0:10350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2352:x1877914532547200:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 86us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919149.269269:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 94 00000100:00100000:3.0:1790919149.269287:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 95 00000100:00100000:3.0:1790919149.269293:0:10350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:2352:x1877914532547072:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1790919149.269321:0:10350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:2352:x1877914532547072:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 28us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919149.269327:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 95 00000100:00100000:3.0:1790919149.269344:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532546944 00000100:00100000:3.0:1790919149.269348:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532546944 00000100:00100000:3.0:1790919149.269371:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532547328 00000100:00100000:3.0:1790919149.269374:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532547328 00000100:00100000:3.0:1790919149.269392:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 160 00000100:00100000:3.0:1790919149.269398:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+18:2352:x1877914532546944:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1790919149.269748:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+18:2352:x1877914532546944:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 348us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919149.269756:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 160 00000100:00100000:3.0:1790919149.269772:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 161 00000100:00100000:3.0:1790919149.269779:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5591729f-44f1-43f1-b042-c3a508737d97+5:2352:x1877914532547328:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1790919149.269805:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5591729f-44f1-43f1-b042-c3a508737d97+5:2352:x1877914532547328:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 27us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919149.269811:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 161 00000100:00080000:3.0:1790919149.269840:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790919149.269845:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790919149.269847:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790919149.270108:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532546816 00000100:00100000:1.0:1790919149.270113:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532546816 00000100:00100000:1.0:1790919149.270148:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 299 00000100:00100000:1.0:1790919149.270156:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+13:2352:x1877914532546816:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:1.0:1790919149.270187:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:002ffd4e-702a-440d-a423-3e840d72bb2e+13:2352:x1877914532546816:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 32us (1203us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919149.270193:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 299 00000040:00080000:2.0:1790919149.375782:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790919149.375792:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790919149.375843:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1790919149.375861:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1790919149.826584:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919150.848082:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beba14e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1877914550354432:0@lo:400:kworker.0 00000100:00100000:2.0:1790919150.848245:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919150.848305:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790919150.848313:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550354560:0@lo:400:kworker.0 00000100:00100000:2.0:1790919150.848341:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919150.848381:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550354432 00000100:00100000:2.0:1790919150.848388:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550354432 00000100:00100000:2.0:1790919150.848442:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1790919150.848452:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877914550354432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919150.848503:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877914550354432:12345-0@lo:400:kworker.0 Request processed in 53us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919150.848511:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1790919150.848594:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beba14fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877914550354304:0@lo:400:kworker.0 00000100:00100000:1.0:1790919150.848627:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919150.848634:0:10350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550354560 00000100:00100000:2.0:1790919150.848638:0:10350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550354560 00000100:00100000:1.0:1790919150.848646:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf732300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550354816:0@lo:400:kworker.0 00000100:00100000:1.0:1790919150.848668:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919150.848691:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1790919150.848696:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beba14dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3306:1877914550354176:0@lo:400:kworker.0 00000100:00100000:1.0:1790919150.848724:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919150.848745:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1877914550354688:0@lo:400:kworker.0 00000100:00100000:1.0:1790919150.848767:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919150.848791:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550354816 00000100:00100000:1.0:1790919150.848809:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550354816 00000100:00100000:2.0:1790919150.848862:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790919150.848870:0:10350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf730e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550354560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919150.848906:0:10350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf730e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550354560:12345-0@lo:400:kworker.0 Request processed in 37us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919150.848912:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:2.0:1790919150.848931:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790919150.848934:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790919150.848937:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790919150.848945:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550354304 00000100:00100000:2.0:1790919150.848949:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550354304 00000100:00100000:2.0:1790919150.848967:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550354688 00000100:00100000:2.0:1790919150.848970:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550354688 00000100:00100000:2.0:1790919150.848988:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1790919150.848994:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877914550354304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919150.849043:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877914550354304:12345-0@lo:400:kworker.0 Request processed in 49us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919150.849049:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1790919150.849061:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1790919150.849066:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb40e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877914550354688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919150.849088:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb40e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877914550354688:12345-0@lo:400:kworker.0 Request processed in 22us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919150.849093:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:2.0:1790919150.849118:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790919150.849674:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550354176 00000100:00100000:0.0:1790919150.849682:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550354176 00000100:00100000:0.0:1790919150.849714:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1790919150.849721:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3306:x1877914550354176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919150.849763:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3306:x1877914550354176:12345-0@lo:400:kworker.0 Request processed in 43us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919150.849769:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00010000:00010000:0.0:1790919150.849821:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919150.849962:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1790919150.849968:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88bebf751500, transno 4294967322 00000004:00080000:2.0:1790919150.849989:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:2.0:1790919150.850012:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550354560:0@lo:400:kworker.0 00000100:00100000:2.0:1790919150.850026:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beba14e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1877914550354432:0@lo:400:kworker.0 00000100:00100000:2.0:1790919150.850058:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beba14dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3306:1877914550354176:0@lo:400:kworker.0 00000100:00100000:2.0:1790919150.850069:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1877914550354688:0@lo:400:kworker.0 00000100:00100000:2.0:1790919150.850079:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beba14fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877914550354304:0@lo:400:kworker.0 00000100:00100000:1.0:1790919150.854277:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1790919150.854294:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb40e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550354816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919150.854387:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb40e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550354816:12345-0@lo:400:kworker.0 Request processed in 98us (5717us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919150.854402:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1790919150.854451:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1790919150.854458:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88bd827f1880, transno 4294967310 00000100:00100000:1.0:1790919150.854472:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf732300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550354816:0@lo:400:kworker.0 00000100:00100000:3.0:1790919151.323894:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919151.328619:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532547456 00000100:00100000:2.0:1790919151.328636:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532547456 00000100:00100000:2.0:1790919151.330304:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 237 00000100:00100000:2.0:1790919151.330328:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd82803100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+18:11272:x1877914532547456:12345-192.168.201.27@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1790919151.330454:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd82803100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+18:11272:x1877914532547456:12345-192.168.201.27@tcp:60:lhsmtool_posix.0 Request processed in 137us (6937us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919151.330479:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 237 00000100:00080000:0.0:1790919151.332924:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790919151.337316:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919151.337413:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532547712 00000100:00100000:2.0:1790919151.337425:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532547712 00000100:00100000:2.0:1790919151.337486:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 65 00000100:00100000:2.0:1790919151.337498:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb413ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+18:11272:x1877914532547712:12345-192.168.201.27@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790919151.338037:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb413ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+19:11272:x1877914532547712:12345-192.168.201.27@tcp:35:lhsmtool_posix.0 Request processed in 540us (728us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1790919151.338584:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 65 00000100:00100000:1.0:1790919151.361157:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790919151.361181:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550354944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790919151.361252:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919151.361397:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550354944 00000100:00100000:3.0:1790919151.361406:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550354944 00000100:00100000:3.0:1790919151.361458:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790919151.361468:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb40e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550354944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790919151.361502:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919151.361572:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb40e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550354944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919151.361578:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790919151.362004:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550354944:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790919151.872800:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919152.900861:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790919153.340053:0:12841:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 01:32:32 (1790919152) 00000100:00100000:0.0:1790919153.407934:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790919153.408020:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550355072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790919153.408090:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919153.408148:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550355072 00000100:00100000:0.0:1790919153.408155:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550355072 00000100:00100000:0.0:1790919153.408209:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790919153.408217:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf751500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550355072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790919153.408254:0:6701:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790919153.408301:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf751500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550355072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919153.408308:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1790919153.408329:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790919153.408443:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550355072:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1790919153.472253:0:5869:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1790919153.472268:0:5869:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1790919153.472319:0:5880:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1790919153.472329:0:5880:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1790919153.924253:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919154.384101:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919154.384148:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919154.384187:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919154.384214:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919154.384240:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919154.384268:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532548352 00000100:00100000:3.0:1790919154.384278:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532548352 00000100:00100000:3.0:1790919154.384332:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532547968 00000100:00100000:3.0:1790919154.384335:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532547968 00000100:00100000:3.0:1790919154.384359:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 165 00000100:00100000:3.0:1790919154.384368:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4139f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5591729f-44f1-43f1-b042-c3a508737d97+5:2351:x1877914532548352:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1790919154.384456:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4139f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5591729f-44f1-43f1-b042-c3a508737d97+5:2351:x1877914532548352:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 88us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919154.384473:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 165 00000100:00100000:3.0:1790919154.384490:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 166 00000100:00100000:3.0:1790919154.384497:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb413b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+18:2351:x1877914532547968:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:2.0:1790919154.384648:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532547840 00000100:00100000:2.0:1790919154.384653:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532547840 00000100:00100000:2.0:1790919154.384684:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 301 00000100:00100000:2.0:1790919154.384690:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+13:2351:x1877914532547840:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:2.0:1790919154.384720:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:002ffd4e-702a-440d-a423-3e840d72bb2e+13:2351:x1877914532547840:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 30us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919154.384726:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 301 00000100:00100000:0.0:1790919154.384886:0:10350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532548096 00000100:00100000:0.0:1790919154.384890:0:10350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532548096 00000100:00100000:0.0:1790919154.384934:0:10350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532548224 00000100:00100000:0.0:1790919154.384938:0:10350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532548224 00000100:00100000:0.0:1790919154.384959:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 98 00000100:00100000:0.0:1790919154.384966:0:10350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4138a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:2351:x1877914532548096:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:0.0:1790919154.384994:0:10350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4138a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:2351:x1877914532548096:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 29us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919154.385000:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 98 00000100:00100000:0.0:1790919154.385013:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 99 00000100:00100000:0.0:1790919154.385019:0:10350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb413a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2351:x1877914532548224:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:0.0:1790919154.385040:0:10350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb413a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2351:x1877914532548224:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 21us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919154.385046:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 99 00000100:00100000:3.0:1790919154.385157:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb413b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+18:2351:x1877914532547968:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 659us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919154.385164:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 166 00000100:00080000:3.0:1790919154.385187:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790919154.385191:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790919154.385193:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790919154.947671:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919155.851518:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919155.852166:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532548480 00000100:00100000:0.0:1790919155.852177:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532548480 00000100:00100000:0.0:1790919155.852233:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 238 00000100:00100000:0.0:1790919155.852243:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4139180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5591729f-44f1-43f1-b042-c3a508737d97+5:12286:x1877914532548480:12345-192.168.201.27@tcp:101:lsof.0 00010000:00010000:0.0:1790919155.852264:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919155.852609:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c5220 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cf69 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919155.852675:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c5227 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919155.852691:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c5227 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919155.852717:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c5227 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919155.852767:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790919155.852771:0:5845:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790919155.852808:0:5845:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c5227 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919155.852832:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c5220 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf69 expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919155.852851:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c5227 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf69 expref: 6 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919155.852860:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be85efc000) 00010000:00010000:0.0:1790919155.852863:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790919155.852866:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac59200, rc 0) 00000100:00100000:0.0:1790919155.853316:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4139180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5591729f-44f1-43f1-b042-c3a508737d97+6:12286:x1877914532548480:12345-192.168.201.27@tcp:101:lsof.0 Request processed in 1072us (1807us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919155.853324:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 238 00000100:00100000:1.0:1790919155.967830:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790919155.969114:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beba14fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877914550355328:0@lo:400:kworker.0 00010000:00010000:0.0:1790919155.969127:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919155.969184:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919155.969237:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf732300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3306:1877914550355200:0@lo:400:kworker.0 00000100:00100000:1.0:1790919155.969266:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919155.969305:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550355200 00000100:00100000:0.0:1790919155.969314:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550355200 00000100:00100000:0.0:1790919155.969366:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1790919155.969375:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87166050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3306:x1877914550355200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919155.969434:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87166050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3306:x1877914550355200:12345-0@lo:400:kworker.0 Request processed in 60us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919155.969440:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1790919155.969487:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf732300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3306:1877914550355200:0@lo:400:kworker.0 00000100:00100000:3.0:1790919155.972775:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550355328 00000100:00100000:3.0:1790919155.972796:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550355328 00000100:00100000:3.0:1790919155.972870:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1790919155.972880:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb40e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877914550355328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919155.972983:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb40e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877914550355328:12345-0@lo:400:kworker.0 Request processed in 104us (3798us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919155.972990:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1790919155.973212:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beba14fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877914550355328:0@lo:400:kworker.0 00000100:00100000:3.0:1790919155.975129:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beba14dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1877914550355456:0@lo:400:kworker.0 00000100:00100000:3.0:1790919155.975199:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919155.975313:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550355456 00000100:00100000:0.0:1790919155.975321:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550355456 00000100:00100000:0.0:1790919155.975376:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1790919155.975385:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877914550355456:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1790919155.975521:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790919155.978745:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beba14e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550355584:0@lo:400:kworker.0 00000100:00100000:1.0:1790919155.978835:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919155.978904:0:10350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550355584 00000100:00100000:1.0:1790919155.978912:0:10350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550355584 00000100:00100000:1.0:1790919155.978978:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790919155.978989:0:10350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb40e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550355584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919155.979043:0:10350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb40e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550355584:12345-0@lo:400:kworker.0 Request processed in 56us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919155.979065:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:1.0:1790919155.979093:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790919155.979124:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beba14e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550355584:0@lo:400:kworker.0 00000100:00100000:0.0:1790919155.979822:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877914550355456:12345-0@lo:400:kworker.0 Request processed in 4435us (4619us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919155.979832:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1790919155.981142:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beba14dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1877914550355456:0@lo:400:kworker.0 00000100:00100000:0.0:1790919155.982287:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beba14dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1877914550355712:0@lo:400:kworker.0 00000100:00100000:0.0:1790919155.982360:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919155.982457:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550355712 00000100:00100000:1.0:1790919155.982465:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550355712 00000100:00100000:1.0:1790919155.982523:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1790919155.982548:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877914550355712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919155.982904:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beba14e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550355840:0@lo:400:kworker.0 00000100:00100000:3.0:1790919155.982936:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919155.982979:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550355840 00000100:00100000:3.0:1790919155.982983:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550355840 00000100:00100000:3.0:1790919155.983008:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1790919155.983014:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550355840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919155.983045:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550355840:12345-0@lo:400:kworker.0 Request processed in 31us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919155.983051:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1790919155.983099:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beba14e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550355840:0@lo:400:kworker.0 00000100:00080000:3.0:1790919155.983123:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790919155.983127:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790919155.985714:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877914550355712:12345-0@lo:400:kworker.0 Request processed in 3146us (3332us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919155.985729:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1790919155.987080:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beba14dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1877914550355712:0@lo:400:kworker.0 00000100:00100000:3.0:1790919156.480023:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb40e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550355968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790919156.480106:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919156.480176:0:11721:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550355968 00000100:00100000:1.0:1790919156.480185:0:11721:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550355968 00000100:00100000:1.0:1790919156.480236:0:11721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790919156.480245:0:11721:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be85f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550355968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790919156.480281:0:11721:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919156.480387:0:11721:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be85f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550355968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 142us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919156.480395:0:11721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790919156.482993:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb40e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550355968:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790919156.991951:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919157.522879:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919157.523032:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532548736 00000100:00100000:2.0:1790919157.523042:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532548736 00000100:00100000:2.0:1790919157.523111:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 66 00000100:00100000:2.0:1790919157.523122:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be85f38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+18:12287:x1877914532548736:12345-192.168.201.27@tcp:35:umount.0 00000100:00080000:3.0:1790919157.523798:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790919157.524372:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be85f38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+19:12287:x1877914532548736:12345-192.168.201.27@tcp:35:umount.0 Request processed in 1248us (1497us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1790919157.524383:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 66 00000100:00100000:3.0:1790919157.534661:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919157.534826:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532548992 00000100:00100000:1.0:1790919157.534837:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532548992 00000100:00100000:1.0:1790919157.534897:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 67 00000100:00100000:1.0:1790919157.534907:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be85f3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+19:12287:x1877914532548992:12345-192.168.201.27@tcp:35:umount.0 00000100:00100000:1.0:1790919157.535248:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be85f3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+20:12287:x1877914532548992:12345-192.168.201.27@tcp:35:umount.0 Request processed in 342us (596us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1790919157.535256:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 67 00000100:00100000:0.0:1790919157.543946:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919157.544044:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532549248 00000100:00100000:1.0:1790919157.544054:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532549248 00000100:00100000:1.0:1790919157.544111:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 68 00000100:00100000:1.0:1790919157.544121:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be928c7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+20:12287:x1877914532549248:12345-192.168.201.27@tcp:35:umount.0 00000100:00100000:1.0:1790919157.544349:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be928c7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+21:12287:x1877914532549248:12345-192.168.201.27@tcp:35:umount.0 Request processed in 228us (413us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1790919157.544358:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 68 00000100:00100000:3.0:1790919157.547275:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919157.547435:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532549504 00000100:00100000:1.0:1790919157.547447:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532549504 00000100:00100000:1.0:1790919157.547569:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 69 00000100:00100000:1.0:1790919157.547579:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be85f38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+21:12287:x1877914532549504:12345-192.168.201.27@tcp:35:umount.0 00000100:00100000:1.0:1790919157.547901:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be85f38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+22:12287:x1877914532549504:12345-192.168.201.27@tcp:35:umount.0 Request processed in 322us (632us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1790919157.547909:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 69 00000100:00100000:3.0:1790919157.553934:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919157.553976:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919157.554017:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919157.554132:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532549760 00000100:00100000:0.0:1790919157.554144:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532549760 00000100:00100000:0.0:1790919157.554207:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532549632 00000100:00100000:0.0:1790919157.554211:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532549632 00000100:00100000:0.0:1790919157.554226:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532549888 00000100:00100000:0.0:1790919157.554229:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532549888 00000100:00100000:0.0:1790919157.554246:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 18 00000100:00100000:0.0:1790919157.554255:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be85f39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:002ffd4e-702a-440d-a423-3e840d72bb2e+15:2352:x1877914532549760:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790919157.554271:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919157.554300:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be81516e00/0xc3296956897c4497 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cbc6 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919157.554317:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919157.554385:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 19 00000100:00100000:3.0:1790919157.554397:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be85f38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:002ffd4e-702a-440d-a423-3e840d72bb2e+14:2350:x1877914532549632:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919157.554407:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919157.554417:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be81517800/0xc3296956897c4252 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb02 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919157.554439:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919157.554826:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be85f39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:002ffd4e-702a-440d-a423-3e840d72bb2e+13:2352:x1877914532549760:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 568us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919157.554835:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 18 00000100:00100000:0.0:1790919157.554869:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 20 00000100:00100000:0.0:1790919157.554876:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be85f3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:002ffd4e-702a-440d-a423-3e840d72bb2e+12:2350:x1877914532549888:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790919157.554885:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919157.554894:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be81673a00/0xc3296956897c4213 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cac3 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919157.554905:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919157.554924:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be85f3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:002ffd4e-702a-440d-a423-3e840d72bb2e+11:2350:x1877914532549888:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 49us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919157.554931:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 20 00000100:00100000:1.0:1790919157.555921:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919157.557419:0:10350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532550016 00000100:00100000:0.0:1790919157.557431:0:10350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532550016 00000100:00100000:0.0:1790919157.558222:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 72 00000100:00100000:0.0:1790919157.558233:0:10350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb40e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+5:2349:x1877914532550016:12345-192.168.201.27@tcp:9:umount.0 00000020:00000080:0.0:1790919157.558270:0:10350:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3296956897c4585 00000100:00080000:0.0:1790919157.558281:0:10350:0:(import.c:65:import_set_state_nolock()) ffff88be85450800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790919157.558339:0:10350:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1790919157.558643:0:10350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb40e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+2:2349:x1877914532550016:12345-192.168.201.27@tcp:9:umount.0 Request processed in 412us (2725us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919157.558651:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 72 00010000:00010000:0.0:1790919157.558686:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919157.560014:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be85f38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:002ffd4e-702a-440d-a423-3e840d72bb2e+10:2350:x1877914532549632:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 5611us (6028us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919157.560027:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 19 00000100:00080000:1.0:1790919157.561335:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790919157.572154:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919157.572921:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532550400 00000100:00100000:3.0:1790919157.572933:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532550400 00000100:00100000:3.0:1790919157.573052:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 73 00000100:00100000:3.0:1790919157.573062:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba216a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+7:2349:x1877914532550400:12345-192.168.201.27@tcp:9:umount.0 00000020:00000080:3.0:1790919157.573110:0:6699:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3296956897c47ed 00000020:00010000:3.0:1790919157.573119:0:6699:0:(genops.c:1920:obd_stale_export_put()) Put export ffff88be88dd8000: total 0 00000100:00080000:3.0:1790919157.573123:0:6699:0:(import.c:65:import_set_state_nolock()) ffff88be87131800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790919157.573167:0:6699:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000020:00010000:0.0:1790919157.573227:0:7650:0:(genops.c:1906:obd_stale_export_get()) Get export ffff88be88dd8000: total 0 00010000:00010000:0.0:1790919157.573267:0:7650:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff88be88dd8000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1790919157.573427:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039733a50/0xc3296956897c5219 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf62 expref: 5 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919157.573450:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba216a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+4:2349:x1877914532550400:12345-192.168.201.27@tcp:9:umount.0 Request processed in 387us (1303us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919157.573460:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 73 00010000:00010000:0.0:1790919157.573468:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b864d4c7/0xc3296956897c4b89 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd9b expref: 4 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919157.573494:0:7650:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff88be88dd8000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1790919157.573507:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919157.573509:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919157.573511:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790919157.579048:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790919157.584749:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919157.584895:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532551424 00000100:00100000:1.0:1790919157.584905:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532551424 00000100:00100000:1.0:1790919157.584965:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 239 00000100:00100000:1.0:1790919157.584975:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba14fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+22:2349:x1877914532551424:12345-192.168.201.27@tcp:39:umount.0 00000020:00000080:1.0:1790919157.585011:0:5845:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3296956897c4221 00000020:00010000:1.0:1790919157.585029:0:5845:0:(genops.c:1920:obd_stale_export_put()) Put export ffff88be88c1e800: total 0 00000100:00080000:1.0:1790919157.585034:0:5845:0:(import.c:65:import_set_state_nolock()) ffff88bebaa18000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790919157.585064:0:5845:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:1.0:1790919157.585406:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba14fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4a4e085-55d7-40e9-993c-11b4dfc2d5f5+21:2349:x1877914532551424:12345-192.168.201.27@tcp:39:umount.0 Request processed in 431us (665us total) trans 4294967525 rc 0/0 00000020:00010000:2.0:1790919157.585515:0:5832:0:(genops.c:1906:obd_stale_export_get()) Get export ffff88be88c1e800: total 0 00010000:00010000:2.0:1790919157.585594:0:5832:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff88be88c1e800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1790919157.585629:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88be853b5400) 00010000:00010000:2.0:1790919157.585633:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1790919157.585640:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59600/0xc3296956897c4b74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd94 expref: 21 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919157.585660:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88be8b621100) 00010000:00010000:2.0:1790919157.585662:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790919157.585667:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58400/0xc3296956897c4848 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ccc2 expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919157.585694:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88be8b621700) 00010000:00010000:2.0:1790919157.585697:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790919157.585703:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7ee00/0xc3296956897c44eb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cbd4 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919157.585726:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88be853b5400) 00010000:00010000:2.0:1790919157.585729:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790919157.585733:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672e00/0xc3296956897c4a6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd4e expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919157.585813:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88be853b5800) 00010000:00010000:2.0:1790919157.585816:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790919157.585820:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7e600/0xc3296956897c51da lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf4d expref: 17 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919157.585835:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88be8b621100) 00010000:00010000:2.0:1790919157.585844:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1790919157.585849:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88beb3f7f000/0xc3296956897c455b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cbf0 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919157.585867:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be85efc000) 00010000:00010000:2.0:1790919157.585869:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790919157.585872:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386e00/0xc3296956897c4bdd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdb0 expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919157.585883:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88be853b5800) 00010000:00010000:2.0:1790919157.585886:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1790919157.585889:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c5204 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf5b expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919157.585899:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88be85efcb00) 00010000:00010000:2.0:1790919157.585901:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919157.585905:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386000/0xc3296956897c4507 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cbdb expref: 13 pid: 8231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919157.585918:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88be85efcd00) 00010000:00010000:2.0:1790919157.585920:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790919157.585923:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58e00/0xc3296956897c4ed8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672ce89 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919157.585934:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88be853b5800) 00010000:00010000:2.0:1790919157.585936:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790919157.585939:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81672c00/0xc3296956897c50fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf15 expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919157.585964:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88be85efcd00) 00010000:00010000:2.0:1790919157.585967:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1790919157.585970:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c4bf9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cdb7 expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919157.585983:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88be853b5400) 00010000:00010000:2.0:1790919157.585986:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790919157.585989:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81673600/0xc3296956897c4b4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cd86 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919157.586002:0:5832:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff88be88c1e800, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1790919157.586015:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919157.586017:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919157.586019:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919157.586721:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 239 00010000:00010000:0.0:1790919158.015702:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919158.529183:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf78a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550356096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790919158.529261:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919158.529349:0:6702:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550356096 00000100:00100000:3.0:1790919158.529357:0:6702:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550356096 00000100:00100000:3.0:1790919158.529428:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790919158.529438:0:6702:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf78b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550356096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790919158.529474:0:6702:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1790919158.529483:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790919158.529546:0:6702:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf78b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550356096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919158.529556:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790919158.529578:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf78a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550356096:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1790919158.588451:0:5869:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c4a4e085-55d7-40e9-993c-11b4dfc2d5f5 00000001:00080000:1.0:1790919158.588468:0:5869:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:1.0:1790919158.588482:0:5869:0:(genops.c:885:class_export_put()) final put ffff88be88c1e800/c4a4e085-55d7-40e9-993c-11b4dfc2d5f5 00000020:00000080:3.0:1790919158.588616:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88be88c1e800/c4a4e085-55d7-40e9-993c-11b4dfc2d5f5 for lustre-MDT0000 00000020:00000080:3.0:1790919158.588694:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88bebaa18000 for lustre-MDT0000 00000001:00100000:1.0:1790919158.607920:0:6722:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c4a4e085-55d7-40e9-993c-11b4dfc2d5f5 00000020:00000080:1.0:1790919158.607930:0:6722:0:(genops.c:885:class_export_put()) final put ffff88be88dd8000/c4a4e085-55d7-40e9-993c-11b4dfc2d5f5 00000020:00000080:2.0:1790919158.608521:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88be88dd8000/c4a4e085-55d7-40e9-993c-11b4dfc2d5f5 for lustre-OST0000 00000020:00000080:2.0:1790919158.608610:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88be87131800 for lustre-OST0000 00010000:00010000:0.0:1790919159.040342:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919159.379325:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919159.379386:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919159.379501:0:8529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532551552 00000100:00100000:0.0:1790919159.379513:0:8529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532551552 00000100:00100000:0.0:1790919159.379620:0:8529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532551680 00000100:00100000:0.0:1790919159.379623:0:8529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532551680 00000100:00100000:0.0:1790919159.379664:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 21 00000100:00100000:0.0:1790919159.379674:0:8529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba14dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:002ffd4e-702a-440d-a423-3e840d72bb2e+11:2350:x1877914532551552:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790919159.379691:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919159.379711:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be88387000/0xc3296956897c42f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb10 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919159.379728:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919159.379782:0:8529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba14dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:002ffd4e-702a-440d-a423-3e840d72bb2e+10:2350:x1877914532551552:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 109us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919159.379804:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 21 00000100:00100000:0.0:1790919159.379822:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 22 00000100:00100000:0.0:1790919159.379829:0:8529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba14e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:002ffd4e-702a-440d-a423-3e840d72bb2e+9:2350:x1877914532551680:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790919159.379839:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919159.379865:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be88386400/0xc3296956897c42fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cb3a expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919159.379875:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919159.379896:0:8529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba14e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:002ffd4e-702a-440d-a423-3e840d72bb2e+8:2350:x1877914532551680:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 68us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919159.379903:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 22 00000100:00100000:0.0:1790919159.380726:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919159.380908:0:8529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532551808 00000100:00100000:3.0:1790919159.380914:0:8529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532551808 00000100:00100000:3.0:1790919159.380950:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 23 00000100:00100000:3.0:1790919159.380958:0:8529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be924be050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:002ffd4e-702a-440d-a423-3e840d72bb2e+8:2353:x1877914532551808:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919159.380969:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919159.380982:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be81517000/0xc3296956897c4490 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cbbf expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919159.381010:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919159.381044:0:8529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be924be050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:002ffd4e-702a-440d-a423-3e840d72bb2e+7:2353:x1877914532551808:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 87us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919159.381051:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 23 00000100:00100000:2.0:1790919159.388966:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919159.391657:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532552064 00000100:00100000:3.0:1790919159.391674:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532552064 00000100:00100000:3.0:1790919159.391791:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 240 00000100:00100000:3.0:1790919159.391806:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba14dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5591729f-44f1-43f1-b042-c3a508737d97+6:2349:x1877914532552064:12345-192.168.201.27@tcp:39:umount.0 00000020:00000080:3.0:1790919159.391849:0:8231:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3296956897c4308 00000020:00010000:3.0:1790919159.391856:0:8231:0:(genops.c:1920:obd_stale_export_put()) Put export ffff88bebf7d0000: total 0 00000100:00080000:3.0:1790919159.391861:0:8231:0:(import.c:65:import_set_state_nolock()) ffff88bebf7d4800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790919159.391895:0:8231:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:3.0:1790919159.392304:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba14dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5591729f-44f1-43f1-b042-c3a508737d97+5:2349:x1877914532552064:12345-192.168.201.27@tcp:39:umount.0 Request processed in 501us (3346us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1790919159.392312:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 240 00000100:00080000:0.0:1790919159.393442:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:2.0:1790919159.393571:0:5832:0:(genops.c:1906:obd_stale_export_get()) Get export ffff88bebf7d0000: total 0 00010000:00010000:2.0:1790919159.393578:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919159.393639:0:5832:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff88bebf7d0000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1790919159.393693:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be85efc000) 00010000:00010000:2.0:1790919159.393697:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790919159.393707:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59200/0xc3296956897c5227 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf69 expref: 4 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919159.393759:0:5832:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff88bebf7d0000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1790919159.393772:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919159.393774:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919159.393776:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919159.421413:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919159.421709:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532552320 00000100:00100000:0.0:1790919159.421720:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532552320 00000100:00100000:0.0:1790919159.421788:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 303 00000100:00100000:0.0:1790919159.421800:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87164c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+7:2349:x1877914532552320:12345-192.168.201.27@tcp:251:umount.0 00000020:00000080:0.0:1790919159.421851:0:5840:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3296956897c41fe 00000020:00010000:0.0:1790919159.421860:0:5840:0:(genops.c:1920:obd_stale_export_put()) Put export ffff88bebaa19000: total 0 00000100:00080000:0.0:1790919159.421865:0:5840:0:(import.c:65:import_set_state_nolock()) ffff88bebaa1e800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1790919159.421951:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87164c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:002ffd4e-702a-440d-a423-3e840d72bb2e+3:2349:x1877914532552320:12345-192.168.201.27@tcp:251:umount.0 Request processed in 152us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919159.421959:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 303 00000020:00010000:1.0:1790919159.422139:0:5833:0:(genops.c:1906:obd_stale_export_get()) Get export ffff88bebaa19000: total 0 00010000:00010000:1.0:1790919159.422180:0:5833:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff88bebaa19000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1790919159.422213:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88bd81146200/0xc3296956897c424b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cafb expref: 2 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919159.422227:0:5833:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff88bebaa19000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1790919159.422237:0:5833:0:(genops.c:885:class_export_put()) final put ffff88bebaa19000/002ffd4e-702a-440d-a423-3e840d72bb2e 00010000:00010000:1.0:1790919159.422258:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919159.422261:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919159.422263:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790919159.422304:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88bebaa19000/002ffd4e-702a-440d-a423-3e840d72bb2e for MGS 00000020:00000080:2.0:1790919159.422341:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88bebaa1e800 for MGS 00000040:00080000:0.0:1790919159.616824:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790919159.616841:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790919159.617913:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1790919159.617923:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1790919160.064643:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919161.088727:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877914550356352:0@lo:400:kworker.0 00000100:00100000:2.0:1790919161.088800:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919161.088849:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beba03dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550356864:0@lo:400:kworker.0 00000100:00100000:2.0:1790919161.088878:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919161.088910:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1790919161.088915:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beba14e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3306:1877914550356224:0@lo:400:kworker.0 00000100:00100000:2.0:1790919161.088940:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919161.088961:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beba03d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1877914550356736:0@lo:400:kworker.0 00000100:00100000:2.0:1790919161.088985:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919161.089011:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1877914550356480:0@lo:400:kworker.0 00000100:00100000:2.0:1790919161.089035:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919161.089069:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790919161.089075:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550356608:0@lo:400:kworker.0 00000100:00100000:2.0:1790919161.089097:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919161.089127:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550356352 00000100:00100000:2.0:1790919161.089134:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550356352 00000100:00100000:2.0:1790919161.089177:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550356736 00000100:00100000:2.0:1790919161.089181:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550356736 00000100:00100000:2.0:1790919161.089214:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550356480 00000100:00100000:2.0:1790919161.089217:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550356480 00000100:00100000:2.0:1790919161.089235:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1790919161.089253:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba03f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877914550356352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919161.089309:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba03f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877914550356352:12345-0@lo:400:kworker.0 Request processed in 67us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919161.089316:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1790919161.089334:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1790919161.089341:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877914550356736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919161.089373:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877914550356736:12345-0@lo:400:kworker.0 Request processed in 33us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919161.089378:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1790919161.089388:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1790919161.089394:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877914550356480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919161.089425:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877914550356480:12345-0@lo:400:kworker.0 Request processed in 31us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919161.089431:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1790919161.089448:0:10350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550356864 00000100:00100000:2.0:1790919161.089452:0:10350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550356864 00000100:00100000:2.0:1790919161.089478:0:10350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550356608 00000100:00100000:2.0:1790919161.089480:0:10350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550356608 00000100:00100000:2.0:1790919161.089498:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1790919161.089503:0:10350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba03e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550356864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919161.089553:0:10350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba03e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550356864:12345-0@lo:400:kworker.0 Request processed in 49us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919161.089560:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1790919161.089569:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1790919161.089582:0:10350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf6e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550356608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919161.089608:0:10350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf6e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550356608:12345-0@lo:400:kworker.0 Request processed in 28us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919161.089626:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1790919161.089645:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550356224 00000100:00100000:2.0:1790919161.089649:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550356224 00000100:00100000:2.0:1790919161.089673:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1790919161.089679:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87165050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3306:x1877914550356224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919161.089708:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87165050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3306:x1877914550356224:12345-0@lo:400:kworker.0 Request processed in 30us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919161.089713:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00080000:2.0:1790919161.089749:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790919161.089754:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790919161.089756:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790919161.089790:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550356608:0@lo:400:kworker.0 00000100:00100000:2.0:1790919161.089799:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1877914550356480:0@lo:400:kworker.0 00000100:00100000:2.0:1790919161.089831:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beba14e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3306:1877914550356224:0@lo:400:kworker.0 00000100:00100000:2.0:1790919161.089839:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beba03d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1877914550356736:0@lo:400:kworker.0 00000100:00100000:2.0:1790919161.089847:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877914550356352:0@lo:400:kworker.0 00000100:00100000:2.0:1790919161.089855:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beba03dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550356864:0@lo:400:kworker.0 00010000:00010000:2.0:1790919161.090402:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790919161.113281:0:13040:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1790919161.130763:0:13040:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1790919161.130826:0:13040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be88387600/0xc3296956897c4291 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c4298 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919161.130845:0:13040:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be88387600/0xc3296956897c4291 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c4298 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919161.130867:0:13040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be88387600/0xc3296956897c4291 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3296956897c4298 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919161.130874:0:13040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.127@tcp lock: ffff88be88387600/0xc3296956897c4291 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3296956897c4298 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919161.130894:0:13040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1790919161.130900:0:13040:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1790919161.130919:0:13040:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790919161.130923:0:13040:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1790919161.130928:0:13040:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1790919161.130954:0:13040:0:(import.c:65:import_set_state_nolock()) ffff88bebad52800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1790919161.131038:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877914550356992:0@lo:39:umount.0 00000100:00100000:3.0:1790919161.131128:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919161.131327:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550356992 00000100:00100000:2.0:1790919161.131336:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550356992 00010000:00010000:1.0:1790919161.131383:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1790919161.131384:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00010000:00010000:1.0:1790919161.131391:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff88be88387600/0xc3296956897c4291 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3296956897c4298 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919161.131394:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf788000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877914550356992:12345-0@lo:39:umount.0 00010000:00010000:1.0:1790919161.131399:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88387600 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:1.0:1790919161.131403:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff88be88387600/0xc3296956897c4291 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3296956897c4298 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919161.131411:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff88be88387600/0xc3296956897c4291 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3296956897c4298 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790919161.131418:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff88be88387600/0xc3296956897c4291 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3296956897c4298 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1790919161.131425:0:5847:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3296956897c400d 10000000:01000000:1.0:1790919161.131429:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790919161.131432:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00000100:00080000:2.0:1790919161.131433:0:5847:0:(import.c:65:import_set_state_nolock()) ffff88be9f89c800 : changing import state from FULL to CLOSED 10000000:01000000:1.0:1790919161.131435:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1790919161.131461:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff88be88387600/0xc3296956897c4291 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3296956897c4298 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919161.131468:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790919161.131488:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff88be88387600/0xc3296956897c4291 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3296956897c4298 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919161.131495:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff88be88387600/0xc3296956897c4291 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3296956897c4298 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919161.131498:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf788000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3304:x1877914550356992:12345-0@lo:39:umount.0 Request processed in 107us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919161.131505:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00010000:00010000:1.0:1790919161.131506:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919161.131507:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919161.131509:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790919161.131515:0:5847:0:(genops.c:885:class_export_put()) final put ffff88be9f89f000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1790919161.131566:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88be9f89f000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00100000:2.0:1790919161.131568:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb4266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3307:1877914550357120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790919161.131596:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1790919161.131629:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88be9f89c800 for lustre-MDT0000 00000100:00100000:2.0:1790919161.131651:0:8529:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550357120 00000100:00100000:2.0:1790919161.131655:0:8529:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550357120 00000100:00100000:2.0:1790919161.131698:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790919161.131706:0:8529:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba03dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+19:3307:x1877914550357120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790919161.131718:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919161.131733:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88bd81147e00/0xc3296956897c4298 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3296956897c4291 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919161.131745:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919161.131771:0:8529:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba03dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:3307:x1877914550357120:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919161.131777:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790919161.131807:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb4266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3307:1877914550357120:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1790919161.131832:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88bebad52800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1790919161.131839:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877914550356992:0@lo:39:umount.0 00010000:00010000:0.0:1790919161.131936:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790919161.131945:0:13040:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790919161.131947:0:13040:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1790919161.131950:0:13040:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1790919161.134017:0:13040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88bd81147c00/0xc3296956897c429f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c42a6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919161.134037:0:13040:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88bd81147c00/0xc3296956897c429f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c42a6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919161.134044:0:13040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88bd81147c00/0xc3296956897c429f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3296956897c42a6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919161.134562:0:13040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.127@tcp lock: ffff88bd81147c00/0xc3296956897c429f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3296956897c42a6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919161.135001:0:13040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790919161.135012:0:13040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be81517c00/0xc3296956897c41b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c41bf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919161.135019:0:13040:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be81517c00/0xc3296956897c41b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c41bf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919161.135025:0:13040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be81517c00/0xc3296956897c41b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3296956897c41bf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919161.135031:0:13040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.127@tcp lock: ffff88be81517c00/0xc3296956897c41b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3296956897c41bf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919161.135211:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790919161.135220:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff88bd81147c00/0xc3296956897c429f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3296956897c42a6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919161.135240:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bd81147c00 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:2.0:1790919161.135245:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff88bd81147c00/0xc3296956897c429f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3296956897c42a6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919161.135254:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff88bd81147c00/0xc3296956897c429f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3296956897c42a6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790919161.135261:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff88bd81147c00/0xc3296956897c429f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3296956897c42a6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919161.135267:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790919161.135270:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1790919161.135305:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff88bd81147c00/0xc3296956897c429f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3296956897c42a6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919161.135312:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790919161.135348:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff88bd81147c00/0xc3296956897c429f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3296956897c42a6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919161.135356:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff88bd81147c00/0xc3296956897c429f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3296956897c42a6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919161.135369:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919161.135374:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff88be81517c00/0xc3296956897c41b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3296956897c41bf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919161.135380:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81517c00 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:2.0:1790919161.135382:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff88be81517c00/0xc3296956897c41b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3296956897c41bf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919161.135398:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff88be81517c00/0xc3296956897c41b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3296956897c41bf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790919161.135404:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff88be81517c00/0xc3296956897c41b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3296956897c41bf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919161.135409:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1790919161.135411:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1790919161.135425:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff88be81517c00/0xc3296956897c41b8 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3296956897c41bf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919161.135430:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790919161.135450:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff88be81517c00/0xc3296956897c41b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3296956897c41bf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919161.135458:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919161.135459:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919161.135461:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919161.135496:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beba14e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550357376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790919161.135597:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919161.135671:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550357376 00000100:00100000:2.0:1790919161.135680:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550357376 00000100:00100000:2.0:1790919161.135725:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790919161.135732:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:3305:x1877914550357376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790919161.135743:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919161.135757:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be81517e00/0xc3296956897c41bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3296956897c41b8 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919161.135771:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919161.135808:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:3305:x1877914550357376:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919161.135815:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790919161.135851:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beba14e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3305:1877914550357376:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790919161.135912:0:13040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790919161.135917:0:13040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff88be81517c00/0xc3296956897c41b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3296956897c41bf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919161.135928:0:13040:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1790919161.135936:0:13040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88beb3f7fa00/0xc3296956897c44ba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c44c1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919161.135943:0:13040:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88beb3f7fa00/0xc3296956897c44ba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c44c1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919161.135949:0:13040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88beb3f7fa00/0xc3296956897c44ba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3296956897c44c1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919161.135956:0:13040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.127@tcp lock: ffff88beb3f7fa00/0xc3296956897c44ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3296956897c44c1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919161.135978:0:13040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790919161.135988:0:7650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919161.135992:0:7650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff88beb3f7fa00/0xc3296956897c44ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3296956897c44c1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919161.135998:0:7650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88beb3f7fa00 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:0.0:1790919161.136000:0:7650:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff88beb3f7fa00/0xc3296956897c44ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3296956897c44c1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919161.136006:0:7650:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff88beb3f7fa00/0xc3296956897c44ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3296956897c44c1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790919161.136012:0:7650:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff88beb3f7fa00/0xc3296956897c44ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3296956897c44c1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919161.136017:0:7650:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1790919161.136019:0:7650:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1790919161.136020:0:7650:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1790919161.136033:0:7650:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff88beb3f7fa00/0xc3296956897c44ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3296956897c44c1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919161.136038:0:7650:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790919161.136183:0:7650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff88beb3f7fa00/0xc3296956897c44ba lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3296956897c44c1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919161.136191:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff88beb3f7fa00/0xc3296956897c44ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3296956897c44c1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919161.136203:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919161.136210:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919161.136212:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919161.136223:0:13040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be81672000/0xc3296956897c3f6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c3f73 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919161.136230:0:13040:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be81672000/0xc3296956897c3f6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c3f73 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919161.136237:0:13040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be81672000/0xc3296956897c3f6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3296956897c3f73 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919161.136243:0:13040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.127@tcp lock: ffff88be81672000/0xc3296956897c3f6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3296956897c3f73 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919161.136254:0:13040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1790919161.136257:0:13040:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1790919161.136260:0:13040:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1790919161.136285:0:13040:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1790919161.136290:0:13040:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1790919161.136294:0:13040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790919161.136299:0:13040:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:0.0:1790919161.136304:0:13040:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff88bebf8dc000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790919161.136310:0:13040:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff88bd8117e800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790919161.136317:0:13040:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff88bebf7d0000 5591729f-44f1-43f1-b042-c3a508737d97 192.168.201.27@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790919161.136322:0:13040:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff88bebad40000) has exports, disconnecting them 00000020:00080000:0.0:1790919161.136326:0:13040:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff88bebf8dc000), last request at 1790919161 00000020:00000080:0.0:1790919161.136333:0:13040:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3296956897c4180 00000100:00080000:0.0:1790919161.136350:0:13040:0:(import.c:65:import_set_state_nolock()) ffff88bebf8d8800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1790919161.136384:0:7650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919161.136393:0:7650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff88be81672000/0xc3296956897c3f6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3296956897c3f73 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919161.136400:0:7650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81672000 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:0.0:1790919161.136403:0:7650:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff88be81672000/0xc3296956897c3f6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3296956897c3f73 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919161.136406:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1790919161.136411:0:7650:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff88be81672000/0xc3296956897c3f6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3296956897c3f73 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919161.136417:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beba03d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3307:1877914550357248:0@lo:103:ldlm_bl.0 10000000:00010000:0.0:1790919161.136418:0:7650:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff88be81672000/0xc3296956897c3f6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3296956897c3f73 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919161.136423:0:7650:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1790919161.136426:0:7650:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1790919161.136428:0:7650:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1790919161.136443:0:7650:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff88be81672000/0xc3296956897c3f6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3296956897c3f73 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919161.136450:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790919161.136450:0:7650:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790919161.136457:0:7650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff88be81672000/0xc3296956897c3f6c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3296956897c3f73 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919161.136463:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff88be81672000/0xc3296956897c3f6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3296956897c3f73 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919161.136468:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3307:1877914550357632:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790919161.136475:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919161.136477:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919161.136478:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919161.136486:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1790919161.136492:0:13040:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff88bebf8dc000): rc 0 00000020:00000080:0.0:1790919161.136495:0:13040:0:(genops.c:885:class_export_put()) final put ffff88bebf8dc000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1790919161.136509:0:13040:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff88bd8117e800), last request at 1790919161 00000100:00100000:1.0:1790919161.136511:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550357248 00000020:00000080:0.0:1790919161.136512:0:13040:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3296956897c40b5 00000100:00100000:1.0:1790919161.136515:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550357248 00000100:00080000:0.0:1790919161.136518:0:13040:0:(import.c:65:import_set_state_nolock()) ffff88bd81179800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1790919161.136551:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919161.136553:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550357632 00000100:00100000:1.0:1790919161.136556:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550357632 00000020:00080000:0.0:1790919161.136559:0:13040:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff88bd8117e800): rc 0 00000020:00000080:0.0:1790919161.136561:0:13040:0:(genops.c:885:class_export_put()) final put ffff88bd8117e800/lustre-MDT0000-lwp-OST0000_UUID 00000100:00100000:1.0:1790919161.136573:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000004:00000080:0.0:1790919161.136575:0:13040:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff9f1703bb7ae0 00000100:00100000:1.0:1790919161.136580:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4266d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+18:3307:x1877914550357248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790919161.136595:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:0.0:1790919161.136595:0:13040:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00010000:00010000:1.0:1790919161.136625:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be81516400/0xc3296956897c42a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3296956897c429f expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919161.136637:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919161.136669:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4266d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+17:3307:x1877914550357248:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919161.136675:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790919161.136692:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790919161.136698:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb413ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+16:3307:x1877914550357632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790919161.136705:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919161.136713:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be80031e00/0xc3296956897c3f73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3296956897c3f6c expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919161.136724:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919161.136746:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb413ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+15:3307:x1877914550357632:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919161.136751:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790919161.136776:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3307:1877914550357632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790919161.136784:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beba03d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3307:1877914550357248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790919161.136931:0:13040:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1790919161.136989:0:13040:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1790919161.137050:0:13040:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1790919161.137076:0:13040:0:(import.c:65:import_set_state_nolock()) ffff88be88c8e000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1790919161.137098:0:13040:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1790919161.137100:0:13040:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1790919161.137123:0:13040:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1790919161.137192:0:13040:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1790919161.137201:0:13040:0:(import.c:65:import_set_state_nolock()) ffff88be88c1e000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1790919161.137234:0:13040:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff88bebad40000) has no exports 00010000:00010000:2.0:1790919161.137308:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790919161.137318:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88bebf8dc000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1790919161.137368:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88bd8117e800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1790919161.137392:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88bebf8d8800 for lustre-MDT0000 00000020:00000080:2.0:1790919161.137396:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88bd81179800 for lustre-MDT0000 00000100:00100000:2.0:1790919161.137415:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88be88d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3306:1877914550357504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790919161.137448:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919161.137484:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550357504 00000100:00100000:2.0:1790919161.137488:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550357504 00000100:00100000:2.0:1790919161.137513:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790919161.137518:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+15:3306:x1877914550357504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790919161.137547:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919161.137557:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be81516800/0xc3296956897c44c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3296956897c44ba expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919161.137568:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919161.137594:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+14:3306:x1877914550357504:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919161.137600:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790919161.137638:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88be88d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3306:1877914550357504:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790919161.137662:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919161.137727:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1877914550357760:0@lo:9:umount.0 00000100:00100000:1.0:1790919161.137761:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919161.137792:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1877914550357888:0@lo:9:umount.0 00000100:00100000:1.0:1790919161.137814:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919161.138208:0:10350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550357760 00000100:00100000:0.0:1790919161.138213:0:10350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550357760 00000100:00100000:0.0:1790919161.138248:0:10350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550357888 00000100:00100000:0.0:1790919161.138251:0:10350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550357888 00000100:00100000:0.0:1790919161.138271:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790919161.138277:0:10350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba03d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1877914550357760:12345-0@lo:9:umount.0 00000020:00000080:0.0:1790919161.138296:0:10350:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3296956897c4102 00000100:00080000:0.0:1790919161.138305:0:10350:0:(import.c:65:import_set_state_nolock()) ffff88bebf875000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790919161.138333:0:10350:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00010000:00010000:1.0:1790919161.138566:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919161.138695:0:10350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba03d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3304:x1877914550357760:12345-0@lo:9:umount.0 Request processed in 416us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919161.138717:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790919161.138733:0:10350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790919161.138739:0:10350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bd827f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1877914550357888:12345-0@lo:9:umount.0 00000020:00000080:0.0:1790919161.138753:0:10350:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3296956897c41e9 00000100:00080000:0.0:1790919161.138759:0:10350:0:(import.c:65:import_set_state_nolock()) ffff88bd82852800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790919161.138778:0:10350:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1790919161.138872:0:10350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bd827f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3304:x1877914550357888:12345-0@lo:9:umount.0 Request processed in 132us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919161.138878:0:10350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:0.0:1790919161.138893:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790919161.139434:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88be88c8e000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1790919161.139455:0:3304:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1790919161.139458:0:3304:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790919161.139461:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1877914550357760:0@lo:9:umount.0 00000100:00080000:1.0:1790919161.139476:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88be88c1e000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1790919161.139491:0:3304:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1790919161.139493:0:3304:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790919161.139496:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1877914550357888:0@lo:9:umount.0 00000020:00080000:3.0:1790919161.144036:0:13040:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff88bebad40000) has no exports 00000020:00000080:3.0:1790919161.193989:0:13040:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3296956897c3fc7 00000020:00000080:3.0:1790919161.194007:0:13040:0:(genops.c:885:class_export_put()) final put ffff88beb35a6000/lustre-QMT0000_UUID 00000020:01000000:3.0:1790919161.194020:0:13040:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1790919161.194102:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88beb35a6000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1790919161.197517:0:13040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790919161.197553:0:13040:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1790919161.197576:0:13040:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff88be88c9b380) has no exports 00000020:00000080:1.0:1790919161.199930:0:13040:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3296956897c3fc0 00000020:00000080:1.0:1790919161.199944:0:13040:0:(genops.c:885:class_export_put()) final put ffff88bebbde3000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790919161.200004:0:13040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790919161.200015:0:13040:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1790919161.200019:0:13040:0:(genops.c:885:class_export_put()) final put ffff88beb35a4800/lustre-QMT0000_UUID 00000020:00000080:1.0:1790919161.200021:0:13040:0:(genops.c:844:class_export_destroy()) destroying export ffff88beb35a4800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1790919161.200027:0:13040:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1790919161.200082:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88bebbde3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:2.0:1790919162.112215:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790919162.677631:0:7662:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790919162.677640:0:7662:0:(genops.c:885:class_export_put()) final put ffff88bd82853000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1790919162.677665:0:7662:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c4a4e085-55d7-40e9-993c-11b4dfc2d5f5 00000020:00000080:0.0:1790919162.677667:0:7662:0:(genops.c:885:class_export_put()) final put ffff88be85453800/c4a4e085-55d7-40e9-993c-11b4dfc2d5f5 00000020:00000080:1.0:1790919162.677960:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88bd82853000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1790919162.678014:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88be85453800/c4a4e085-55d7-40e9-993c-11b4dfc2d5f5 for lustre-OST0001 00000020:00000080:1.0:1790919162.678030:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88bd82852800 for lustre-OST0001 00000020:00000080:1.0:1790919162.678034:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88be85450800 for lustre-OST0001 00010000:00010000:1.0:1790919163.135851:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790919163.689109:0:6722:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790919163.689119:0:6722:0:(genops.c:885:class_export_put()) final put ffff88bebf871000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790919163.689245:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88bebf871000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1790919163.689295:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88bebf875000 for lustre-OST0000 00000001:00100000:1.0:1790919163.689729:0:5869:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5591729f-44f1-43f1-b042-c3a508737d97 00000001:00080000:1.0:1790919163.689741:0:5869:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1790919163.689744:0:5869:0:(genops.c:885:class_export_put()) final put ffff88bebf7d0000/5591729f-44f1-43f1-b042-c3a508737d97 00000020:00000080:2.0:1790919163.689801:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88bebf7d0000/5591729f-44f1-43f1-b042-c3a508737d97 for lustre-MDT0000 00000020:00000080:2.0:1790919163.689844:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88bebf7d4800 for lustre-MDT0000 00010000:00010000:0.0:1790919164.159804:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919165.185415:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919166.207849:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790919166.207879:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3307:1877914550358016:0@lo:400:kworker.0 00000100:00100000:2.0:1790919166.207925:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1877914550358144:0@lo:400:kworker.0 00000100:00100000:3.0:1790919166.207952:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919166.207969:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919166.208027:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1877914550358272:0@lo:400:kworker.0 00000100:00100000:3.0:1790919166.208074:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919166.208121:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550358144 00000100:00100000:3.0:1790919166.208125:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550358272 00000100:00100000:0.0:1790919166.208130:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550358144 00000100:00100000:3.0:1790919166.208131:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550358272 00000100:00100000:3.0:1790919166.208176:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1790919166.208188:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550358016 00000100:00100000:3.0:1790919166.208193:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf78a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3306:x1877914550358272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919166.208194:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550358016 00000020:00080000:3.0:1790919166.208204:0:5846:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1790919166.208232:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1790919166.208249:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf78a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3306:x1877914550358272:12345-0@lo:400:kworker.0 Request processed in 64us (174us total) trans 0 rc -107/-107 00000100:00100000:1.0:1790919166.208257:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be87164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+14:3307:x1877914550358016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919166.208261:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1790919166.208318:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be87164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5+14:3307:x1877914550358016:12345-0@lo:400:kworker.0 Request processed in 78us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919166.208334:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1790919166.208391:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3307:1877914550358016:0@lo:400:kworker.0 00010000:00010000:1.0:1790919166.208422:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790919166.216023:0:3306:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1790919166.216032:0:3306:0:(import.c:65:import_set_state_nolock()) ffff88beb3f1c800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1790919166.216037:0:3306:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1790919166.217045:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1790919166.217054:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88d98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3305:x1877914550358144:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1790919166.217063:0:8231:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1790919166.217137:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88d98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3305:x1877914550358144:12345-0@lo:400:kworker.0 Request processed in 83us (9168us total) trans 0 rc -107/-107 00000100:00100000:0.0:1790919166.217144:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:0.0:1790919166.217181:0:3305:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1790919166.217185:0:3305:0:(import.c:65:import_set_state_nolock()) ffff88bd8117f800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1790919166.217202:0:3305:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1790919166.217207:0:3305:0:(import.c:65:import_set_state_nolock()) ffff88bd8117f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790919166.217211:0:3305:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 156 00000100:00080000:0.0:1790919166.217221:0:3305:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff88bd8117f800 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:0.0:1790919166.219472:0:3305:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88bebac5d880 x1877914550358400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790919166.219511:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1877914550358144:0@lo:400:kworker.0 00000100:00100000:0.0:1790919166.219581:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1877914550358400:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1790919166.219641:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919166.219684:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550358400 00000100:00100000:0.0:1790919166.219690:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550358400 00000100:00100000:0.0:1790919166.219719:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1790919166.219725:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1877914550358400:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1790919166.219740:0:5847:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:2.0:1790919166.238519:0:3306:0:(import.c:65:import_set_state_nolock()) ffff88beb3f1c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790919166.238561:0:3306:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 176 00000100:00080000:2.0:1790919166.238579:0:3306:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88beb3f1c800 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:2.0:1790919166.238621:0:3306:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88beba14e300 x1877914550358528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790919166.238660:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1877914550358272:0@lo:400:kworker.0 00000100:00100000:2.0:1790919166.238727:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beba14e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1877914550358528:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1790919166.238794:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919166.239183:0:8231:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550358528 00000100:00100000:1.0:1790919166.239204:0:8231:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550358528 00000100:00100000:1.0:1790919166.239246:0:8231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1790919166.239254:0:8231:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3304:x1877914550358528:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1790919166.239270:0:8231:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1790919166.239316:0:8231:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3304:x1877914550358528:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 61us (522us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790919166.239322:0:8231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:2.0:1790919166.242668:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88beb3f1c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790919166.242681:0:3304:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790919166.242685:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beba14e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1877914550358528:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1790919166.268236:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1877914550358400:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 48503us (48588us total) trans 0 rc -19/-19 00000100:00080000:2.0:1790919166.269259:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88bd8117f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790919166.269297:0:3304:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790919166.269302:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1877914550358400:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1790919166.276995:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00010000:00010000:0.0:1790919167.232027:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1790919167.295658:0:13040:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff88be91c11720 - data ffff88bebfd7f6c0/ffff88beb3f0c000 00000020:01000000:1.0:1790919167.295799:0:13040:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff88be91d9ccc0 - data ffff88bea7f825e8/ffff88bebacc6c00 00000001:00000004:1.0:1790919167.304993:0:13040:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1790919167.468677:0:13040:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1790919167.468685:0:13040:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1790919167.468707:0:13040:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790919167.468709:0:13040:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1790919167.471125:0:7162:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1790919167.471135:0:7162:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1790919167.471146:0:7162:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1790919167.472248:0:13040:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1790919167.472255:0:13040:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1790919167.472277:0:13040:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790919167.472279:0:13040:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1790919167.478232:0:7993:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1790919167.478240:0:7993:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1790919167.478260:0:7993:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1790919167.552259:0:13040:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3296956897c3f8f 00000020:00000080:0.0:1790919167.552273:0:13040:0:(genops.c:885:class_export_put()) final put ffff88be83803000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1790919167.552972:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88be83803000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1790919167.555160:0:13040:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3296956897c3fa4 00000020:00000080:0.0:1790919167.555181:0:13040:0:(genops.c:885:class_export_put()) final put ffff88bebad56000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1790919167.555239:0:13040:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1790919167.555245:0:13040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790919167.555262:0:13040:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790919167.555266:0:13040:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff88bebad419c0) has no exports 00000004:01000000:0.0:1790919167.555436:0:13040:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1790919167.555444:0:13040:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3296956897c41e2 00000020:00000080:0.0:1790919167.555449:0:13040:0:(genops.c:885:class_export_put()) final put ffff88bd82853800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790919167.561098:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88bebad56000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1790919167.561723:0:13040:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1790919167.561735:0:13040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790919167.561748:0:13040:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1790919167.561752:0:13040:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff88bebaa34d40) has no exports 00000020:00000080:0.0:1790919167.561761:0:13040:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3296956897c41db 00000020:00000080:0.0:1790919167.561770:0:13040:0:(genops.c:885:class_export_put()) final put ffff88be88c1c800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1790919167.561802:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88bd82853800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1790919167.566616:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88be88c1c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1790919167.567139:0:13040:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1790919167.567145:0:13040:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1790919167.567148:0:13040:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1790919167.567155:0:13040:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790919167.567157:0:13040:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790919167.567236:0:13040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790919167.567257:0:13040:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790919167.567266:0:13040:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3296956897c40fb 00000020:00000080:0.0:1790919167.567275:0:13040:0:(genops.c:885:class_export_put()) final put ffff88bebf877800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790919167.569933:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88be88c1e000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1790919167.569948:0:36:0:(genops.c:885:class_export_put()) final put ffff88be88c1b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790919167.569952:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88be88c1b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1790919167.569958:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790919167.570245:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88bebf877800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1790919167.570451:0:13040:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1790919167.570458:0:13040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790919167.570469:0:13040:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790919167.570473:0:13040:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff88be88c74d40) has no exports 00000020:00000080:0.0:1790919167.570480:0:13040:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3296956897c40f4 00000020:00000080:0.0:1790919167.570486:0:13040:0:(genops.c:885:class_export_put()) final put ffff88bebf883800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1790919167.570999:0:13040:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1790919167.571005:0:13040:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1790919167.571009:0:13040:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1790919167.571096:0:13040:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790919167.571098:0:13040:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790919167.571137:0:13040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790919167.571144:0:13040:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790919167.571174:0:13040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790919167.571177:0:13040:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790919167.571181:0:13040:0:(genops.c:885:class_export_put()) final put ffff88beb35e8000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790919167.571184:0:13040:0:(genops.c:844:class_export_destroy()) destroying export ffff88beb35e8000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1790919167.571189:0:13040:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790919167.571606:0:13040:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3296956897c3fab 00000020:00000080:0.0:1790919167.571613:0:13040:0:(genops.c:885:class_export_put()) final put ffff88bebad54800/lustre-MDD0000_UUID 00000020:01000000:0.0:1790919167.571618:0:13040:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1790919167.571622:0:13040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790919167.571626:0:13040:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790919167.571629:0:13040:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff88bebad44d40) has no exports 00000020:00000080:0.0:1790919167.571648:0:13040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790919167.571651:0:13040:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1790919167.571655:0:13040:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3296956897c3fb2 00000020:00000080:0.0:1790919167.571658:0:13040:0:(genops.c:885:class_export_put()) final put ffff88bebad50000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1790919167.571665:0:13040:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88be91614800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1790919167.571668:0:13040:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88be91614800 3 00000020:01000004:0.0:1790919167.571671:0:13040:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff88be91614800 from lustre-MDT0000 00000020:00000080:0.0:1790919167.571688:0:13040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790919167.571691:0:13040:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1790919167.571694:0:13040:0:(genops.c:885:class_export_put()) final put ffff88be83804800/lustre-MDT0000_UUID 00000020:00000080:0.0:1790919167.571696:0:13040:0:(genops.c:844:class_export_destroy()) destroying export ffff88be83804800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1790919167.571703:0:13040:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1790919167.571730:0:13040:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1790919167.571733:0:13040:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1790919167.571736:0:13040:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1790919167.571739:0:13040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790919167.571741:0:13040:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1790919167.571748:0:13040:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff88be9005c800 0e69af01-203c-4f0d-87cf-1d5cbb9aaea5 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790919167.571760:0:13040:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff88be88c9cd40) has exports, disconnecting them 00000020:00080000:0.0:1790919167.571764:0:13040:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff88be9005c800), last request at 1790918936 00000020:00000080:0.0:1790919167.571779:0:13040:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3296956897c3f49 00000020:00010000:0.0:1790919167.571783:0:13040:0:(genops.c:1920:obd_stale_export_put()) Put export ffff88be9005c800: total 3 00000100:00080000:0.0:1790919167.571798:0:13040:0:(import.c:65:import_set_state_nolock()) ffff88be9005f000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1790919167.571818:0:13040:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff88be9005c800): rc 0 00000020:00080000:0.0:1790919167.571822:0:13040:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff88be88c9cd40) has no exports 00000020:00010000:3.0:1790919167.571953:0:5832:0:(genops.c:1906:obd_stale_export_get()) Get export ffff88be9005c800: total 3 00010000:00010000:3.0:1790919167.571982:0:5832:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff88be9005c800, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1790919167.572009:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be88386800/0xc3296956897c4260 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3296956897c4259 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919167.572036:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be81672600/0xc3296956897c426e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3296956897c4267 expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919167.572048:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88bd81146800/0xc3296956897c428a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3296956897c4283 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919167.572059:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be81517400/0xc3296956897c427c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3296956897c4275 expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919167.572071:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be81516c00/0xc3296956897c44a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3296956897c449e expref: 5 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919167.572081:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be88387800/0xc3296956897c42b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3296956897c42ad expref: 4 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919167.572103:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88bebac58800/0xc3296956897c44b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3296956897c44ac expref: 3 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919167.572116:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be80031400/0xc3296956897c4068 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3296956897c4061 expref: 2 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919167.572127:0:5832:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff88be9005c800, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1790919167.572140:0:5832:0:(genops.c:885:class_export_put()) final put ffff88be9005c800/0e69af01-203c-4f0d-87cf-1d5cbb9aaea5 00010000:00010000:3.0:1790919167.572146:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919167.572148:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919167.572150:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919167.572453:0:5840:0:(service.c:3206:ptlrpc_main()) ll_mgs_0002: service thread [ffff88be927bb000:5840] 2 exiting: rc = 0 00000020:00000080:2.0:1790919167.572566:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88bebf883800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1790919167.572573:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88be88c8e000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1790919167.572579:0:36:0:(genops.c:885:class_export_put()) final put ffff88bebf886000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790919167.572581:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88bebf886000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1790919167.572585:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790919167.572660:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88bebad54800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1790919167.572664:0:36:0:(genops.c:885:class_export_put()) final put ffff88beb35ec800/lustre-MDD0000_UUID 00000020:00000080:2.0:1790919167.572666:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88beb35ec800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1790919167.572669:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1790919167.572830:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88bebad50000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1790919167.572834:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88be9005c800/0e69af01-203c-4f0d-87cf-1d5cbb9aaea5 for MGS 00000020:00000080:2.0:1790919167.572860:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88be9005f000 for MGS 00000100:00100000:1.0:1790919167.573043:0:5838:0:(service.c:3206:ptlrpc_main()) ll_mgs_0000: service thread [ffff88be927ba600:5838] 0 exiting: rc = 1 00000100:00100000:1.0:1790919167.573091:0:5839:0:(service.c:3206:ptlrpc_main()) ll_mgs_0001: service thread [ffff88be927ba400:5839] 1 exiting: rc = 0 00000100:00100000:0.0:1790919167.573628:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573636:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573643:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573650:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573656:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573661:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573667:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573674:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573680:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573687:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573693:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573699:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573705:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573710:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573716:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573722:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573728:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573734:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573740:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573746:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573751:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573757:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573763:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573769:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573775:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573781:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573807:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573812:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573818:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573825:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573830:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573837:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573842:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573849:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573854:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573860:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573866:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573872:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573878:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573884:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573890:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573896:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573901:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573907:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573912:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573917:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573923:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573928:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573934:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573939:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573945:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573950:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573956:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573961:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573967:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573973:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573979:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573985:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573991:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.573996:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.574002:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.574181:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.574189:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.574194:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1790919167.574949:0:13040:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1790919167.574953:0:13040:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:2.0:1790919167.576700:0:13040:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff88be91c11660 - data ffff88bebfd7f510/ffff88bebfbbf000 00000020:01000000:2.0:1790919167.576833:0:13040:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff88beb0b49900 - data ffff88bea7dae360/ffff88be8e084800 00000020:00000080:2.0:1790919167.577821:0:13040:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3296956897c3f34 00000020:00000080:2.0:1790919167.577830:0:13040:0:(genops.c:885:class_export_put()) final put ffff88be91cd1800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1790919167.577843:0:13040:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88be91614800 from MGS, refs=2 00000020:01000004:2.0:1790919167.577846:0:13040:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88be91614800 2 00000020:01000004:2.0:1790919167.577850:0:13040:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff88be91614800 from MGS 00000020:00000080:2.0:1790919167.577875:0:13040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790919167.577881:0:13040:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1790919167.577884:0:13040:0:(genops.c:885:class_export_put()) final put ffff88be91cd7000/MGS 00000020:00000080:2.0:1790919167.577887:0:13040:0:(genops.c:844:class_export_destroy()) destroying export ffff88be91cd7000/MGS for MGS 00000020:01000000:2.0:1790919167.577895:0:13040:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1790919167.577953:0:13040:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1790919167.577957:0:13040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790919167.577962:0:13040:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790919167.577970:0:13040:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff88bebad55000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790919167.577977:0:13040:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff88bebad43380) has exports, disconnecting them 00000020:00080000:2.0:1790919167.577981:0:13040:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff88bebad55000), last request at 1790918937 00000020:00000080:2.0:1790919167.577986:0:13040:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3296956897c3fff 00000020:00080000:2.0:1790919167.577996:0:13040:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff88bebad55000): rc 0 00000020:00000080:2.0:1790919167.578000:0:13040:0:(genops.c:885:class_export_put()) final put ffff88bebad55000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1790919167.578090:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88be91cd1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1790919167.578103:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88bebad55000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1790919167.581834:0:13040:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1790919167.581843:0:13040:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790919167.581848:0:13040:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1790919167.581856:0:13040:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790919167.582049:0:13040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790919167.582058:0:13040:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1790919167.582067:0:13040:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88be91614800 1 00000020:00000080:3.0:1790919167.582074:0:13040:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3296956897c3f26 00000020:00000080:3.0:1790919167.582083:0:13040:0:(genops.c:885:class_export_put()) final put ffff88be91cd5800/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1790919167.582089:0:13040:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1790919167.582094:0:13040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790919167.582098:0:13040:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1790919167.582102:0:13040:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff88be8716b380) has no exports 00000020:00000080:0.0:1790919167.585476:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88bebad52800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1790919167.585489:0:8:0:(genops.c:885:class_export_put()) final put ffff88bebad55800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1790919167.585492:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88bebad55800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1790919167.585515:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1790919167.585593:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88be91cd5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1790919167.634168:0:13040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790919167.634183:0:13040:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1790919167.634188:0:13040:0:(genops.c:885:class_export_put()) final put ffff88be9005a000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1790919167.634207:0:13040:0:(genops.c:844:class_export_destroy()) destroying export ffff88be9005a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1790919167.634214:0:13040:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1790919167.634358:0:13040:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff88be91610000 00000020:01000000:3.0:1790919167.634382:0:13040:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1790919167.634387:0:13040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790919167.634392:0:13040:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1790919167.634397:0:13040:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff88be88d319c0) has no exports 00000100:00100000:3.0:1790919167.634479:0:5846:0:(service.c:3206:ptlrpc_main()) mdt00_001: service thread [ffff88be88d46600:5846] 1 exiting: rc = 0 00000100:00100000:0.0:1790919167.637218:0:5847:0:(service.c:3206:ptlrpc_main()) mdt00_002: service thread [ffff88be88d46c00:5847] 2 exiting: rc = 0 00000100:00100000:1.0:1790919167.637738:0:8231:0:(service.c:3206:ptlrpc_main()) mdt00_003: service thread [ffff88beb40d5000:8231] 3 exiting: rc = 0 00000100:00100000:2.0:1790919167.639106:0:5845:0:(service.c:3206:ptlrpc_main()) mdt00_000: service thread [ffff88be88d47200:5845] 0 exiting: rc = 1 00000100:00100000:3.0:1790919167.639297:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639305:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639320:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639326:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639331:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639336:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639342:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639347:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639353:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639360:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639365:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639371:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639376:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639381:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639386:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639392:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639398:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639403:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639408:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639414:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639419:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639424:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639429:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639434:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639440:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639446:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639463:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639468:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639473:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639479:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639483:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639489:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639519:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639542:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639550:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639556:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639562:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639568:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639574:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639579:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639585:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639591:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639596:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639603:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639609:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639615:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639621:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639627:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639634:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639640:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639646:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639652:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639658:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639664:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639670:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639676:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639682:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639688:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639694:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639699:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639705:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639718:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639724:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.639729:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.649002:0:5849:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff88be88d4c800:5849] 1 exiting: rc = 0 00000100:00100000:0.0:1790919167.649951:0:5848:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff88be927bb400:5848] 0 exiting: rc = 1 00000100:00100000:3.0:1790919167.651647:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651658:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651664:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651670:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651675:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651681:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651688:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651694:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651699:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651705:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651710:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651716:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651723:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651728:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651734:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651738:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651743:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651748:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651753:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651759:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651764:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651769:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651775:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651779:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651784:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651802:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651808:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651813:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651818:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651822:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651828:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651846:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651852:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651857:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651863:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651868:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651873:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651878:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651885:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651890:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651896:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651901:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651906:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651912:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651917:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651922:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651928:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651934:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651940:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651945:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651951:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651957:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651962:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651968:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651974:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651980:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651985:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651990:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.651995:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.652001:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.652006:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.652152:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.652160:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.652166:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.652734:0:12544:0:(service.c:3206:ptlrpc_main()) mdt_out00_002: service thread [ffff88bebaa27c00:12544] 2 exiting: rc = 0 00000100:00100000:0.0:1790919167.652886:0:5850:0:(service.c:3206:ptlrpc_main()) mdt_out00_000: service thread [ffff88be9246ae00:5850] 0 exiting: rc = 1 00000100:00100000:3.0:1790919167.652973:0:5851:0:(service.c:3206:ptlrpc_main()) mdt_out00_001: service thread [ffff88be92621200:5851] 1 exiting: rc = 0 00000100:00100000:3.0:1790919167.653098:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653105:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653111:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653116:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653122:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653128:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653145:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653151:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653157:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653163:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653169:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653174:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653180:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653186:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653191:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653197:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653203:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653209:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653226:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653233:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653238:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653254:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653262:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653267:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653273:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653279:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653285:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653291:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653296:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653302:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653388:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653395:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653401:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653407:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653412:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653424:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653430:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653436:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653442:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653447:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653453:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653458:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653476:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653482:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653488:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653493:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653508:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653515:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653521:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653633:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653642:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653648:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653654:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653661:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653681:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653688:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653695:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653701:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653708:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653714:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653720:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653726:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653733:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.653739:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.667687:0:5852:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0000: service thread [ffff88be8e1aa000:5852] 0 exiting: rc = 1 00000100:00100000:3.0:1790919167.667938:0:5853:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0001: service thread [ffff88be8e1aac00:5853] 1 exiting: rc = 0 00000100:00100000:3.0:1790919167.668020:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668028:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668034:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668039:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668044:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668064:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668070:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668075:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668079:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668084:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668089:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668094:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668100:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668105:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668110:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668114:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668120:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668124:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668129:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668133:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668138:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668143:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668148:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668153:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668159:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668163:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668168:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668174:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668178:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668184:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668188:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668193:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668198:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668203:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668208:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668213:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668218:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668223:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668228:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668234:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668246:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668251:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668256:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668261:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668266:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668271:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668277:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668282:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668287:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668292:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668298:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668303:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668308:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668313:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668318:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668323:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668327:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668332:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668336:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668342:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668346:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668350:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668356:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668361:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.668713:0:5854:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0000: service thread [ffff88be8e1ab200:5854] 0 exiting: rc = 1 00000100:00100000:0.0:1790919167.668918:0:5855:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0001: service thread [ffff88be8e1aae00:5855] 1 exiting: rc = 0 00000100:00100000:3.0:1790919167.671143:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671154:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671159:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671164:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671169:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671174:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671179:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671184:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671188:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671194:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671217:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671222:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671227:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671232:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671237:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671241:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671247:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671252:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671257:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671261:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671267:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671273:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671278:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671283:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671288:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671293:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671298:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671303:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671308:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671313:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671318:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671322:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671326:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671331:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671336:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671341:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671346:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671351:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671356:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671361:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671366:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671371:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671377:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671381:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671385:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671399:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671404:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671409:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671414:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671424:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671429:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671435:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671440:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671444:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671449:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671454:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671459:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671464:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671468:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671473:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671478:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671482:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671487:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.671492:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.678073:0:5856:0:(service.c:3206:ptlrpc_main()) mdt_fld_0000: service thread [ffff88be88dee400:5856] 0 exiting: rc = 1 00000100:00100000:3.0:1790919167.679174:0:5857:0:(service.c:3206:ptlrpc_main()) mdt_fld_0001: service thread [ffff88be8e1ab400:5857] 1 exiting: rc = 0 00000100:00100000:3.0:1790919167.679258:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679265:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679271:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679276:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679282:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679287:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679293:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679298:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679304:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679309:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679314:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679318:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679323:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679328:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679333:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679354:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679360:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679366:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679371:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679375:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679381:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679386:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679391:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679396:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679401:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679407:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679411:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679416:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679421:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679426:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679431:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679436:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679441:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679446:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679451:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679456:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679461:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679466:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679472:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679477:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679482:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679487:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679492:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679496:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679513:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679518:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679524:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679546:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679552:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679557:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679569:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679575:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679580:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679585:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679590:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679595:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679600:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679605:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679610:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679614:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679619:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679625:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679630:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.679636:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919167.683745:0:5859:0:(service.c:3206:ptlrpc_main()) mdt_io00_001: service thread [ffff88be9f940a00:5859] 1 exiting: rc = 0 00000100:00100000:0.0:1790919167.686195:0:5858:0:(service.c:3206:ptlrpc_main()) mdt_io00_000: service thread [ffff88be8e1aaa00:5858] 0 exiting: rc = 1 00000100:00100000:2.0:1790919167.686544:0:5860:0:(service.c:3206:ptlrpc_main()) mdt_io00_002: service thread [ffff88be9f941c00:5860] 2 exiting: rc = 0 00000100:00100000:0.0:1790919167.687662:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687671:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687677:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687683:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687689:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687695:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687700:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687705:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687710:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687715:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687721:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687726:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687732:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687737:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687743:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687760:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687764:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687769:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687774:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687800:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687808:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687814:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687819:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687824:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687830:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687836:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687841:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687846:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687852:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687857:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687863:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687868:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687873:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687878:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687884:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687890:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687896:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687901:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687907:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687912:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687917:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687921:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687926:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687946:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687953:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687958:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687966:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687972:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687978:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687984:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.687998:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.688004:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.688019:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.688025:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.688031:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.688036:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.688042:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.688047:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.688053:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.688060:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.688066:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.688071:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.688078:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919167.688091:0:13040:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1790919167.696962:0:13040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790919167.696975:0:13040:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1790919167.696980:0:13040:0:(genops.c:885:class_export_put()) final put ffff88be83807000/MDS_uuid 00000020:00000080:0.0:1790919167.696985:0:13040:0:(genops.c:844:class_export_destroy()) destroying export ffff88be83807000/MDS_uuid for MDS 00000020:01000000:0.0:1790919167.696990:0:13040:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1790919167.697166:0:13040:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1790919168.259219:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919169.280914:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919170.312565:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790919171.039208:0:13195:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1790919171.047093:0:13195:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1790919171.047147:0:13195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be81517600/0xc3296956897c4275 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c427c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919171.047160:0:13195:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be81517600/0xc3296956897c4275 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c427c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919171.047168:0:13195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be81517600/0xc3296956897c4275 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3296956897c427c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919171.047176:0:13195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.127@tcp lock: ffff88be81517600/0xc3296956897c4275 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3296956897c427c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919171.047232:0:13195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790919171.047237:0:13195:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1790919171.047261:0:13195:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790919171.047266:0:13195:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1790919171.047273:0:13195:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1790919171.047280:0:13195:0:(import.c:65:import_set_state_nolock()) ffff88bd8117f800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1790919171.047285:0:13195:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790919171.047287:0:13195:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1790919171.047289:0:13195:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1790919171.048869:0:13195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be88387e00/0xc3296956897c4283 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c428a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919171.048887:0:13195:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be88387e00/0xc3296956897c4283 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c428a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919171.048894:0:13195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be88387e00/0xc3296956897c4283 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3296956897c428a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919171.048919:0:13195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.127@tcp lock: ffff88be88387e00/0xc3296956897c4283 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3296956897c428a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919171.052232:0:7650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790919171.052248:0:7650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff88be81517600/0xc3296956897c4275 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3296956897c427c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919171.052261:0:7650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81517600 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:1.0:1790919171.052265:0:7650:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff88be81517600/0xc3296956897c4275 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3296956897c427c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919171.052275:0:7650:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff88be81517600/0xc3296956897c4275 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3296956897c427c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790919171.052303:0:7650:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff88be81517600/0xc3296956897c4275 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3296956897c427c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919171.052310:0:7650:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790919171.052314:0:7650:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1790919171.052316:0:7650:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1790919171.052600:0:7650:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff88be81517600/0xc3296956897c4275 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3296956897c427c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919171.052608:0:7650:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790919171.052647:0:7650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff88be81517600/0xc3296956897c4275 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3296956897c427c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919171.052655:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff88be81517600/0xc3296956897c4275 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3296956897c427c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919171.052669:0:7650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919171.052672:0:7650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff88be88387e00/0xc3296956897c4283 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3296956897c428a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919171.052678:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3307:1877914550358656:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790919171.052678:0:7650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88387e00 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:1.0:1790919171.052681:0:7650:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff88be88387e00/0xc3296956897c4283 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3296956897c428a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919171.052687:0:7650:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff88be88387e00/0xc3296956897c4283 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3296956897c428a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790919171.052692:0:7650:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff88be88387e00/0xc3296956897c4283 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3296956897c428a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919171.052705:0:7650:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790919171.052708:0:7650:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:1.0:1790919171.052720:0:7650:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff88be88387e00/0xc3296956897c4283 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3296956897c428a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919171.052725:0:7650:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790919171.052731:0:7650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff88be88387e00/0xc3296956897c4283 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3296956897c428a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919171.052737:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919171.052739:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919171.052740:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919171.052747:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919171.052779:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550358656 00000100:00100000:1.0:1790919171.052786:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550358656 00000100:00100000:3.0:1790919171.052804:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790919171.052809:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3307:1877914550358784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790919171.052826:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790919171.052832:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919171.052834:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf78bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3307:x1877914550358656:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1790919171.052840:0:5829:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790919171 with bad export cookie 14062887131835809609 00000100:00100000:3.0:1790919171.052855:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550358784 00000100:00100000:3.0:1790919171.052859:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550358784 00000100:00100000:3.0:1790919171.052878:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790919171.052882:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be924bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3307:x1877914550358784:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1790919171.052886:0:5831:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790919171 with bad export cookie 14062887131835809609 00000100:00100000:3.0:1790919171.052925:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be924bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3307:x1877914550358784:12345-0@lo:103:ldlm_bl.0 Request processed in 41us (91us total) trans 0 rc -107/-107 00000100:00100000:3.0:1790919171.052931:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1790919171.052964:0:3307:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.127@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1790919171.052969:0:3307:0:(import.c:65:import_set_state_nolock()) ffff88be83800000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1790919171.052979:0:3307:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:2.0:1790919171.053304:0:13195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1790919171.053312:0:13195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff88be88387e00/0xc3296956897c4283 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3296956897c428a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919171.053409:0:13195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be81517200/0xc3296956897c44ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c44b3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919171.053418:0:13195:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be81517200/0xc3296956897c44ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c44b3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919171.053425:0:13195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be81517200/0xc3296956897c44ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3296956897c44b3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919171.053432:0:13195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.127@tcp lock: ffff88be81517200/0xc3296956897c44ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3296956897c44b3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919171.053456:0:13195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790919171.053461:0:13195:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:2.0:1790919171.053465:0:13195:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1790919171.053491:0:13195:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1790919171.053495:0:13195:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00010000:00010000:2.0:1790919171.053503:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919171.053508:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff88be81517200/0xc3296956897c44ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3296956897c44b3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919171.053515:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81517200 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:2.0:1790919171.053539:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff88be81517200/0xc3296956897c44ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3296956897c44b3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919171.053547:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff88be81517200/0xc3296956897c44ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3296956897c44b3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790919171.053553:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff88be81517200/0xc3296956897c44ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3296956897c44b3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919171.053559:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1790919171.053562:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1790919171.053563:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1790919171.053653:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919171.060065:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf78bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3307:x1877914550358656:12345-0@lo:103:ldlm_bl.0 Request processed in 7225us (7313us total) trans 0 rc -107/-107 00000100:00100000:1.0:1790919171.060079:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000020:00000080:0.0:1790919171.061091:0:13195:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790919171.061102:0:13195:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1790919171.061106:0:13195:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff88bebf8e0000) has no exports 00000020:00080000:0.0:1790919171.061132:0:13195:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff88bebf8e0000) has no exports 00000020:01000000:0.0:1790919171.063999:0:13195:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff88be855f1cc0 - data ffff88bebfd44360/ffff88beb382c000 00000020:01000000:0.0:1790919171.064150:0:13195:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff88be86b43360 - data ffff88bead23a288/ffff88bebf891800 00000100:00080000:3.0:1790919171.080594:0:3307:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.127@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1790919171.080599:0:3307:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1790919171.080610:0:3307:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88beb3b3a680 x1877914550358656/t0(0) o103->MGC192.168.201.127@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790919187 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919171.080624:0:3307:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88beb3b39880 x1877914550358784/t0(0) o103->MGC192.168.201.127@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790919187 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1790919171.080703:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff88be81517200/0xc3296956897c44ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3296956897c44b3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919171.080716:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790919171.080749:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff88be81517200/0xc3296956897c44ac lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3296956897c44b3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919171.080757:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff88be81517200/0xc3296956897c44ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3296956897c44b3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919171.080777:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919171.080779:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919171.080780:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790919171.081735:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1790919171.081741:0:3307:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1790919171.081743:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1790919171.081747:0:3307:0:(import.c:65:import_set_state_nolock()) ffff88be83800000 MGS: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1790919171.081749:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:0:1877914550358912:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1790919171.081752:0:3307:0:(import.c:545:import_select_connection()) MGC192.168.201.127@tcp: connect to NID 0@lo last attempt 138 00000100:00080000:3.0:1790919171.081765:0:3307:0:(import.c:666:import_select_connection()) MGC192.168.201.127@tcp: import ffff88be83800000 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:3.0:1790919171.083888:0:3307:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88bebf78ad80 x1877914550359040/t0(0) o250->MGC192.168.201.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790919171.083938:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3307:1877914550358656:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790919171.083955:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf78ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3304:1877914550359040:0@lo:250:ptlrpcd_00_02.0 00000100:00100000:3.0:1790919171.083960:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3307:1877914550358784:0@lo:103:ldlm_bl.0 00000400:00000100:2.0:1790919171.084005:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877914550359040 offset 0 length 520: 4 00100000:10000000:0.0:1790919171.101176:0:13195:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1790919171.136490:0:13195:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3296956897c4084 00000020:00000080:3.0:1790919171.136499:0:13195:0:(genops.c:885:class_export_put()) final put ffff88bebf8da000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1790919171.136517:0:13195:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88be86b70000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1790919171.136521:0:13195:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88be86b70000 2 00000020:01000004:3.0:1790919171.136555:0:13195:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff88be86b70000 from lustre-OST0000 00000020:00000080:2.0:1790919171.136974:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88bebf8da000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1790919171.137015:0:13195:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790919171.137025:0:13195:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1790919171.137028:0:13195:0:(genops.c:885:class_export_put()) final put ffff88bebf8dd000/lustre-OST0000_UUID 00000020:00000080:3.0:1790919171.137031:0:13195:0:(genops.c:844:class_export_destroy()) destroying export ffff88bebf8dd000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1790919171.137037:0:13195:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1790919171.137085:0:13195:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1790919171.137103:0:13195:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1790919171.137107:0:13195:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790919171.137111:0:13195:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1790919171.137118:0:13195:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff88bd81179000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790919171.137124:0:13195:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff88bebf8e4d40) has exports, disconnecting them 00000020:00080000:3.0:1790919171.137128:0:13195:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff88bd81179000), last request at 1790918954 00000020:00000080:3.0:1790919171.137133:0:13195:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3296956897c40ae 00000020:00080000:3.0:1790919171.137143:0:13195:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff88bd81179000): rc 0 00000020:00000080:3.0:1790919171.137147:0:13195:0:(genops.c:885:class_export_put()) final put ffff88bd81179000/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1790919171.138162:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88bd81179000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1790919171.138386:0:13195:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1790919171.138399:0:13195:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790919171.138403:0:13195:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1790919171.138409:0:13195:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790919171.138574:0:13195:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790919171.138590:0:13195:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1790919171.138595:0:13195:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88be86b70000 1 00000020:00000080:2.0:1790919171.138600:0:13195:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3296956897c403e 00000020:00000080:2.0:1790919171.138606:0:13195:0:(genops.c:885:class_export_put()) final put ffff88beb35e8800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1790919171.138610:0:13195:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1790919171.138613:0:13195:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790919171.138617:0:13195:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1790919171.138620:0:13195:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff88be88c999c0) has no exports 00000020:00000080:0.0:1790919171.138825:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88bd8117f800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1790919171.138832:0:8:0:(genops.c:885:class_export_put()) final put ffff88bebf8db800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1790919171.138842:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88bebf8db800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1790919171.138847:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1790919171.138888:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88beb35e8800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1790919171.156501:0:13195:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790919171.156517:0:13195:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1790919171.156523:0:13195:0:(genops.c:885:class_export_put()) final put ffff88be86b71000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1790919171.156551:0:13195:0:(genops.c:844:class_export_destroy()) destroying export ffff88be86b71000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1790919171.156558:0:13195:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1790919171.157817:0:13195:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff88be86b76800 00000020:02000400:2.0:1790919171.157871:0:13195:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:2.0:1790919171.327891:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0e69af01-203c-4f0d-87cf-1d5cbb9aaea5->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790919171.327901:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 0e69af01-203c-4f0d-87cf-1d5cbb9aaea5->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790919171.327904:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790919171.327907:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790919171.327911:0:36:0:(import.c:65:import_set_state_nolock()) ffff88beb3f1c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790919171.327920:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 368 00000100:00080000:2.0:1790919171.327925:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790919171.327938:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88beb3f1c800 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:2.0:1790919171.327973:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88bebf74ea00 x1877914550359168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790919171.328029:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1877914550359168:0@lo:38:kworker.0 00000400:00000100:2.0:1790919171.328079:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877914550359168 offset 0 length 520: 4 00010000:00010000:2.0:1790919171.332985:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919172.353897:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919173.380962:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1790919173.743354:0:13345:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1790919173.753281:0:13345:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1790919173.753376:0:13345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be81517a00/0xc3296956897c4259 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c4260 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919173.753391:0:13345:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be81517a00/0xc3296956897c4259 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c4260 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919173.753410:0:13345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be81517a00/0xc3296956897c4259 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3296956897c4260 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919173.753418:0:13345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.127@tcp lock: ffff88be81517a00/0xc3296956897c4259 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3296956897c4260 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919173.755271:0:13345:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790919173.755283:0:13345:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1790919173.755314:0:13345:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790919173.755326:0:13345:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88bebf74ea00 x1877914550359168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790919186 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919173.755346:0:13345:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1790919173.755352:0:13345:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1790919173.755358:0:13345:0:(import.c:65:import_set_state_nolock()) ffff88beb3f1c800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1790919173.755363:0:13345:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790919173.755368:0:13345:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88bebf74ea00 x1877914550359168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790919186 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919173.755406:0:13345:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1790919173.755410:0:13345:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:0.0:1790919173.756296:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1877914550359168:0@lo:38:kworker.0 00010000:00010000:2.0:1790919173.758298:0:13345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88bd81147400/0xc3296956897c4267 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c426e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919173.758314:0:13345:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88bd81147400/0xc3296956897c4267 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c426e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919173.758321:0:13345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88bd81147400/0xc3296956897c4267 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3296956897c426e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919173.758327:0:13345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.127@tcp lock: ffff88bd81147400/0xc3296956897c4267 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3296956897c426e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919173.758648:0:7650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790919173.758656:0:7650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff88be81517a00/0xc3296956897c4259 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3296956897c4260 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919173.758664:0:7650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81517a00 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:3.0:1790919173.758667:0:7650:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff88be81517a00/0xc3296956897c4259 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3296956897c4260 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919173.758676:0:7650:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff88be81517a00/0xc3296956897c4259 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3296956897c4260 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790919173.758683:0:7650:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff88be81517a00/0xc3296956897c4259 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3296956897c4260 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919173.758688:0:7650:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790919173.758690:0:7650:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1790919173.758693:0:7650:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1790919173.758707:0:7650:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff88be83800000 00010000:00010000:3.0:1790919173.758711:0:7650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff88be81517a00/0xc3296956897c4259 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3296956897c4260 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919173.758739:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff88be81517a00/0xc3296956897c4259 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3296956897c4260 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919173.758754:0:7650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790919173.758758:0:7650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff88bd81147400/0xc3296956897c4267 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3296956897c426e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919173.758763:0:7650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bd81147400 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:3.0:1790919173.758765:0:7650:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff88bd81147400/0xc3296956897c4267 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3296956897c426e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919173.758772:0:7650:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff88bd81147400/0xc3296956897c4267 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3296956897c426e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790919173.758778:0:7650:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff88bd81147400/0xc3296956897c4267 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3296956897c426e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919173.758782:0:7650:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790919173.758784:0:7650:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:3.0:1790919173.758788:0:7650:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff88be83800000 00010000:00010000:3.0:1790919173.758790:0:7650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff88bd81147400/0xc3296956897c4267 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3296956897c426e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919173.758796:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919173.758798:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919173.758800:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919173.758917:0:13345:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1790919173.758924:0:13345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff88bd81147400/0xc3296956897c4267 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3296956897c426e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919173.758937:0:13345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be88386a00/0xc3296956897c449e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c44a5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919173.758944:0:13345:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be88386a00/0xc3296956897c449e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c44a5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919173.758950:0:13345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be88386a00/0xc3296956897c449e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3296956897c44a5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919173.758955:0:13345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.127@tcp lock: ffff88be88386a00/0xc3296956897c449e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3296956897c44a5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919173.759030:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919173.759037:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff88be88386a00/0xc3296956897c449e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3296956897c44a5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919173.759043:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386a00 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:1.0:1790919173.759046:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff88be88386a00/0xc3296956897c449e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3296956897c44a5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919173.759064:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff88be88386a00/0xc3296956897c449e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3296956897c44a5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790919173.759071:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff88be88386a00/0xc3296956897c449e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3296956897c44a5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919173.759076:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1790919173.759079:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1790919173.759084:0:5833:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff88be83800000 00010000:00010000:1.0:1790919173.759087:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff88be88386a00/0xc3296956897c449e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3296956897c44a5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919173.759094:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919173.759096:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919173.759098:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919173.759230:0:13345:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1790919173.759235:0:13345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff88be88386a00/0xc3296956897c449e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3296956897c44a5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919173.759249:0:13345:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1790919173.759254:0:13345:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:2.0:1790919173.759256:0:13345:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1790919173.759279:0:13345:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1790919173.759283:0:13345:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1790919173.759289:0:13345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790919173.759294:0:13345:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1790919173.759299:0:13345:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff88bebf8e19c0) has no exports 00000020:00080000:2.0:1790919173.759327:0:13345:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff88bebf8e19c0) has no exports 00010000:00010000:0.0:1790919173.759728:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1790919173.761937:0:13345:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff88be855f1060 - data ffff88bead288bd0/ffff88beb382e800 00000020:01000000:2.0:1790919173.762101:0:13345:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff88beb44dcba0 - data ffff88bea7f1fa20/ffff88bebac11000 00100000:10000000:2.0:1790919173.774262:0:13345:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1790919173.807332:0:13345:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3296956897c414f 00000020:00000080:1.0:1790919173.807345:0:13345:0:(genops.c:885:class_export_put()) final put ffff88beb3f1f000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1790919173.807369:0:13345:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88bebf8da800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1790919173.807372:0:13345:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88bebf8da800 2 00000020:01000004:1.0:1790919173.807376:0:13345:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff88bebf8da800 from lustre-OST0001 00000020:00000080:1.0:1790919173.807409:0:13345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790919173.807420:0:13345:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1790919173.807423:0:13345:0:(genops.c:885:class_export_put()) final put ffff88beb3f18000/lustre-OST0001_UUID 00000020:00000080:1.0:1790919173.807426:0:13345:0:(genops.c:844:class_export_destroy()) destroying export ffff88beb3f18000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1790919173.807433:0:13345:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:2.0:1790919173.807789:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88beb3f1f000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:0.0:1790919173.807906:0:13345:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 0e69af01-203c-4f0d-87cf-1d5cbb9aaea5->MGS 00010000:00010000:0.0:1790919173.807925:0:13345:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff88be80030800/0xc3296956897c4061 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3296956897c4068 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790919173.807938:0:13345:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff88be80030800/0xc3296956897c4061 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3296956897c4068 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919173.807945:0:13345:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1790919173.807948:0:13345:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1790919173.807952:0:13345:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1790919173.807977:0:13345:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff88be83800000 00010000:00010000:0.0:1790919173.807981:0:13345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff88be80030800/0xc3296956897c4061 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3296956897c4068 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919173.807998:0:13345:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff88bd81146e00/0xc3296956897c42ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3296956897c42b4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790919173.808005:0:13345:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff88bd81146e00/0xc3296956897c42ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3296956897c42b4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919173.808010:0:13345:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790919173.808013:0:13345:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1790919173.808015:0:13345:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1790919173.808042:0:13345:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff88be83800000 00010000:00010000:0.0:1790919173.808046:0:13345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff88bd81146e00/0xc3296956897c42ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3296956897c42b4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1790919173.808064:0:13345:0:(import.c:65:import_set_state_nolock()) ffff88be83800000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1790919173.808067:0:13345:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1790919173.808069:0:13345:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1790919173.808071:0:13345:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1790919173.808075:0:13345:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1790919173.808086:0:13345:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88bebf78ad80 x1877914550359040/t0(0) o250->MGC192.168.201.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1790919181 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1790919173.808107:0:13345:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1790919173.808110:0:13345:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 00000100:00100000:2.0:1790919173.808176:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf78ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0e69af01-203c-4f0d-87cf-1d5cbb9aaea5:3304:1877914550359040:0@lo:250:ptlrpcd_00_02.0 10000000:01000000:0.0:1790919173.808243:0:13345:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1790919173.808250:0:13345:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3296956897c3f42 00000020:00000080:0.0:1790919173.808255:0:13345:0:(genops.c:885:class_export_put()) final put ffff88be83805000/0e69af01-203c-4f0d-87cf-1d5cbb9aaea5 00000020:01000000:0.0:1790919173.808271:0:13345:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.127@tcp (flags='') 00000020:00000080:0.0:1790919173.808277:0:13345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790919173.808282:0:13345:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.127@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1790919173.808286:0:13345:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff88be88d33380) has no exports 00000020:00000080:2.0:1790919173.808341:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88be83805000/0e69af01-203c-4f0d-87cf-1d5cbb9aaea5 for MGC192.168.201.127@tcp 10000000:01000000:1.0:1790919173.808391:0:5842:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1790919173.808479:0:13345:0:(obd_class.h:668:obd_cleanup_client_import()) MGC192.168.201.127@tcp: client import never connected 00000100:00080000:0.0:1790919173.808482:0:13345:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1790919173.808484:0:13345:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1790919173.808486:0:13345:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1790919173.808488:0:13345:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1790919173.808565:0:13345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790919173.808570:0:13345:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.127@tcp (uuid 0e69af01-203c-4f0d-87cf-1d5cbb9aaea5) 00000020:01000000:0.0:1790919173.808574:0:13345:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1790919173.808578:0:13345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790919173.808581:0:13345:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00000080:2.0:1790919173.809058:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88be83800000 for MGC192.168.201.127@tcp 00000020:00000080:2.0:1790919173.809064:0:8:0:(genops.c:885:class_export_put()) final put ffff88be91617800/0e69af01-203c-4f0d-87cf-1d5cbb9aaea5 00000020:00000080:2.0:1790919173.809067:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88be91617800/0e69af01-203c-4f0d-87cf-1d5cbb9aaea5 for MGC192.168.201.127@tcp 00000020:01000000:2.0:1790919173.809071:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.127@tcp (0e69af01-203c-4f0d-87cf-1d5cbb9aaea5) 00000020:00080000:0.0:1790919173.809338:0:13345:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff88bebf8df800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790919173.809345:0:13345:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff88bebaa30000) has exports, disconnecting them 00000020:00080000:0.0:1790919173.809358:0:13345:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff88bebf8df800), last request at 1790918975 00000020:00000080:0.0:1790919173.809362:0:13345:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3296956897c4179 00000020:00080000:0.0:1790919173.809375:0:13345:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff88bebf8df800): rc 0 00000020:00000080:0.0:1790919173.809378:0:13345:0:(genops.c:885:class_export_put()) final put ffff88bebf8df800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1790919173.810036:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88bebf8df800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1790919173.836822:0:13345:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1790919173.836833:0:13345:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790919173.836837:0:13345:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790919173.836846:0:13345:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790919173.837000:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88beb3f1c800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1790919173.837032:0:7650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1790919173.837251:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1790919173.837416:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1790919173.837679:0:5827:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_000: service thread [ffff88be82bfb200:5827] 0 exiting: rc = 1 00000100:00100000:1.0:1790919173.837777:0:5828:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_001: service thread [ffff88be82bfb400:5828] 1 exiting: rc = 0 00000100:00100000:0.0:1790919173.837868:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838118:0:8529:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_003: service thread [ffff88bebfbff600:8529] 3 exiting: rc = 0 00000100:00100000:1.0:1790919173.838249:0:5830:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_001: service thread [ffff88be82bfa800:5830] 1 exiting: rc = 0 00000100:00100000:1.0:1790919173.838300:0:5829:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_000: service thread [ffff88be82bfbe00:5829] 0 exiting: rc = 1 00000100:00100000:2.0:1790919173.838390:0:5831:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_002: service thread [ffff88be82bfa400:5831] 2 exiting: rc = 0 00000100:00100000:0.0:1790919173.838483:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838492:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838498:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838505:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838510:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838516:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838522:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838715:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838721:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838726:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838732:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838737:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838742:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838749:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838757:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838764:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838769:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838775:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838780:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838786:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838792:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838797:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838803:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838817:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838822:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838827:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838833:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838838:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838843:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838848:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838854:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838859:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838864:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838869:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838874:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838879:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838884:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838889:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838894:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838899:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838904:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838909:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838914:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838919:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838925:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838930:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838934:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838940:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838945:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838950:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838955:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838960:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838966:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838973:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838978:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838983:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838988:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.838994:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.839009:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.839014:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.839019:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.839024:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.839029:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.839034:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1790919173.852465:0:13345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790919173.852477:0:13345:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1790919173.852482:0:13345:0:(genops.c:885:class_export_put()) final put ffff88beb3f19800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1790919173.852487:0:13345:0:(genops.c:844:class_export_destroy()) destroying export ffff88beb3f19800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1790919173.852493:0:13345:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1790919173.852571:0:13345:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88bebf8da800 1 00000020:00000080:1.0:1790919173.852579:0:13345:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3296956897c411e 00000020:00000080:1.0:1790919173.852785:0:13345:0:(genops.c:885:class_export_put()) final put ffff88beb3e16000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1790919173.852803:0:13345:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1790919173.852809:0:13345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790919173.852814:0:13345:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1790919173.852818:0:13345:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff88bebf8e3380) has no exports 00000020:00000080:2.0:1790919173.852929:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88beb3e16000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1790919173.887830:0:13345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790919173.887845:0:13345:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1790919173.887850:0:13345:0:(genops.c:885:class_export_put()) final put ffff88bebf8d9800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1790919173.887855:0:13345:0:(genops.c:844:class_export_destroy()) destroying export ffff88bebf8d9800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1790919173.887861:0:13345:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1790919173.888073:0:13345:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff88bebf8de800 00000020:01000000:1.0:1790919173.888094:0:13345:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1790919173.888097:0:13345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790919173.888102:0:13345:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790919173.888106:0:13345:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff88be88c98000) has no exports 00000020:00000080:1.0:1790919173.888131:0:13345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790919173.888148:0:13345:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1790919173.888152:0:13345:0:(genops.c:885:class_export_put()) final put ffff88beb35ef800/OSS_uuid 00000020:00000080:1.0:1790919173.888154:0:13345:0:(genops.c:844:class_export_destroy()) destroying export ffff88beb35ef800/OSS_uuid for OSS 00000020:01000000:1.0:1790919173.888157:0:13345:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:2.0:1790919173.889024:0:5841:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1790919173.889175:0:6700:0:(service.c:3206:ptlrpc_main()) ll_ost00_002: service thread [ffff88beba52d600:6700] 2 exiting: rc = 0 00000100:00100000:2.0:1790919173.889230:0:6699:0:(service.c:3206:ptlrpc_main()) ll_ost00_001: service thread [ffff88be86b06000:6699] 1 exiting: rc = 0 00000100:00100000:3.0:1790919173.889517:0:6698:0:(service.c:3206:ptlrpc_main()) ll_ost00_000: service thread [ffff88be86b07e00:6698] 0 exiting: rc = 1 00000100:00100000:2.0:1790919173.889900:0:10350:0:(service.c:3206:ptlrpc_main()) ll_ost00_003: service thread [ffff88be8388ee00:10350] 3 exiting: rc = 0 00000100:00100000:1.0:1790919173.890002:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890011:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890019:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890025:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890031:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890049:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890054:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890060:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890065:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890071:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890076:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890082:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890087:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890092:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890097:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890102:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890108:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890113:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890119:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890124:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890129:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890134:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890152:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890157:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890161:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890166:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890171:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890176:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890181:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890186:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890190:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890195:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890200:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890205:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890210:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890216:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890220:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890225:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890229:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890234:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890247:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890252:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890257:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890261:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890265:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890270:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890274:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890279:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890284:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890289:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890294:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890299:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890304:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890309:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890315:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890320:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890325:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890330:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890335:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890341:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890346:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890352:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890357:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.890363:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919173.891510:0:11721:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_002: service thread [ffff88bebf6a8200:11721] 2 exiting: rc = 0 00000100:00100000:3.0:1790919173.892827:0:6702:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_001: service thread [ffff88be88cd2400:6702] 1 exiting: rc = 0 00000100:00100000:0.0:1790919173.900050:0:6701:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_000: service thread [ffff88be88cd2800:6701] 0 exiting: rc = 1 00000100:00100000:1.0:1790919173.900368:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.900906:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.900913:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.900918:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.900924:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.900929:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.900934:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.900939:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.900944:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.900950:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.900956:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.900976:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.900982:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.900988:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.900993:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.900998:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.901004:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.901010:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.901014:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.901019:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.901024:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.901029:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.901033:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.901038:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.901043:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.901048:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.901053:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.901058:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.901063:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.901068:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.901073:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.901078:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.901084:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.901089:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.901094:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.901100:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.901104:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.901109:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.901114:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.901120:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.901125:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.901130:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.901134:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.901240:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.901246:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.901251:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.901263:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.901267:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.901272:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.901277:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.901282:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.901288:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.901293:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.901298:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.901303:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.901308:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.901312:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.901317:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.901322:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.901326:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.901331:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.901336:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.901340:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919173.901345:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.903010:0:6705:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_002: service thread [ffff88be88cd2000:6705] 2 exiting: rc = 0 00000100:00100000:2.0:1790919173.903486:0:6703:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_000: service thread [ffff88be924d6a00:6703] 0 exiting: rc = 1 00000100:00100000:0.0:1790919173.903785:0:6704:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_001: service thread [ffff88be88cd3a00:6704] 1 exiting: rc = 0 00000100:00100000:0.0:1790919173.903842:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.903849:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.903854:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.903859:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.903865:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.903870:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.903883:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.903890:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.903897:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.903902:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.903908:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.903914:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.903919:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.903925:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.903930:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.903935:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.903941:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.903946:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.903951:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.903956:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.903961:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.903966:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.903971:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.903987:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.903993:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.904010:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.904016:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.904021:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.904026:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.904032:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.904037:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.904043:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.904048:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.904053:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.904059:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.904064:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.904069:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.904074:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.904080:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.904085:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.904090:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.904095:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.904100:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.904105:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.904110:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.904116:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.904121:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.904210:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.904218:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.904224:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.904229:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.904235:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.904240:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.904245:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.904250:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.904256:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.904260:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.904266:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.904271:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.904276:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.904288:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.904303:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.904310:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.904315:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919173.917426:0:6706:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff88be88cd3600:6706] 0 exiting: rc = 1 00000100:00100000:2.0:1790919173.917518:0:6707:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff88be88cd3200:6707] 1 exiting: rc = 0 00000100:00100000:0.0:1790919173.917629:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917638:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917643:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917649:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917654:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917660:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917666:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917671:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917676:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917681:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917687:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917692:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917697:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917701:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917707:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917712:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917718:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917722:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917727:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917732:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917737:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917742:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917748:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917754:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917760:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917765:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917770:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917775:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917780:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917785:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917790:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917809:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917814:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917820:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917825:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917829:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917834:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917839:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917843:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917848:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917853:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917858:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917863:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917868:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917873:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917879:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917884:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917889:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917894:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917898:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917903:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917908:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917914:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917920:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917925:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917930:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917935:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917940:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917945:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917949:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917954:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917959:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917964:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.917968:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919173.918958:0:6708:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_000: service thread [ffff88be924d7600:6708] 0 exiting: rc = 1 00000100:00100000:3.0:1790919173.922740:0:6709:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_001: service thread [ffff88beb35cc800:6709] 1 exiting: rc = 0 00000100:00100000:0.0:1790919173.922983:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923003:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923017:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923024:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923030:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923036:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923042:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923048:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923054:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923059:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923066:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923073:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923078:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923085:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923106:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923113:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923119:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923125:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923131:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923148:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923156:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923162:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923168:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923173:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923179:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923186:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923209:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923217:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923223:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923228:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923235:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923241:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923247:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923253:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923259:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923264:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923270:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923284:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923302:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923309:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923315:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923321:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923331:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923341:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923347:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923352:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923359:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923365:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923370:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923375:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923416:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923423:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923429:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923435:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923441:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923448:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923454:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923460:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923467:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923472:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923478:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923484:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923490:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919173.923497:0:13345:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1790919173.948854:0:13345:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1790919191.021196:0:13960:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg127-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1790919201.573320:0:14422:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1790919201.573326:0:14422:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1790919201.573453:0:14422:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff88beb3f1f800 00000020:01000004:1.0:1790919201.573470:0:14422:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1790919201.573479:0:14422:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1790919201.573493:0:14422:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff88bebaa30000) 00000020:00000080:1.0:1790919201.573506:0:14422:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1790919201.592488:0:14422:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1790919201.595052:0:14422:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1790919201.595396:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 419: rc = 0 00100000:10000000:2.0:1790919201.595772:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 419: rc = 0 00100000:10000000:2.0:1790919201.595878:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 419: rc = 0 00100000:10000000:2.0:1790919201.596035:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 419: rc = 0 00100000:10000000:2.0:1790919201.596232:0:14422:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1790919201.596305:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 419: rc = 0 00100000:10000000:2.0:1790919201.596405:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 419: rc = 0 00100000:10000000:2.0:1790919201.596860:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 421: rc = 0 00100000:10000000:2.0:1790919201.599095:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 346: rc = 0 00100000:10000000:2.0:1790919201.599201:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 346: rc = 0 00100000:10000000:2.0:1790919201.600075:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 544: rc = 0 00100000:10000000:2.0:1790919201.600442:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 544: rc = 0 00100000:10000000:2.0:1790919201.601159:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 544: rc = 0 00100000:10000000:2.0:1790919201.601413:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 544: rc = 0 00100000:10000000:2.0:1790919201.601883:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 544: rc = 0 00100000:10000000:2.0:1790919201.602149:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 544: rc = 0 00100000:10000000:2.0:1790919201.602392:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 544: rc = 0 00100000:10000000:2.0:1790919201.602893:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 544: rc = 0 00100000:10000000:2.0:1790919201.603162:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 544: rc = 0 00100000:10000000:2.0:1790919201.603400:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 544: rc = 0 00100000:10000000:2.0:1790919201.603886:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 544: rc = 0 00100000:10000000:2.0:1790919201.604147:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 544: rc = 0 00100000:10000000:2.0:1790919201.604756:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 224: rc = 0 00100000:10000000:2.0:1790919201.605017:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 224: rc = 0 00100000:10000000:2.0:1790919201.605245:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 224: rc = 0 00100000:10000000:2.0:1790919201.605477:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 224: rc = 0 00100000:10000000:2.0:1790919201.605907:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 224: rc = 0 00100000:10000000:2.0:1790919201.606194:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 224: rc = 0 00100000:10000000:2.0:1790919201.606418:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 224: rc = 0 00100000:10000000:2.0:1790919201.607316:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 224: rc = 0 00100000:10000000:2.0:1790919201.607601:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 224: rc = 0 00100000:10000000:2.0:1790919201.608029:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 224: rc = 0 00100000:10000000:2.0:1790919201.608269:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 224: rc = 0 00100000:10000000:2.0:1790919201.608493:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 224: rc = 0 00100000:10000000:2.0:1790919201.608959:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 224: rc = 0 00100000:10000000:2.0:1790919201.609220:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 224: rc = 0 00100000:10000000:2.0:1790919201.609473:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 224: rc = 0 00100000:10000000:2.0:1790919201.609927:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 224: rc = 0 00100000:10000000:2.0:1790919201.610176:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 224: rc = 0 00100000:10000000:2.0:1790919201.610439:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 224: rc = 0 00100000:10000000:2.0:1790919201.611148:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 224: rc = 0 00100000:10000000:2.0:1790919201.611404:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 224: rc = 0 00100000:10000000:2.0:1790919201.612231:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 224: rc = 0 00100000:10000000:2.0:1790919201.612498:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 224: rc = 0 00100000:10000000:2.0:1790919201.612863:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 224: rc = 0 00100000:10000000:2.0:1790919201.613136:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 224: rc = 0 00100000:10000000:2.0:1790919201.613374:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 224: rc = 0 00100000:10000000:2.0:1790919201.613645:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 224: rc = 0 00100000:10000000:2.0:1790919201.614257:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 224: rc = 0 00100000:10000000:2.0:1790919201.614495:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 224: rc = 0 00100000:10000000:2.0:1790919201.614933:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 224: rc = 0 00100000:10000000:2.0:1790919201.615177:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 224: rc = 0 00100000:10000000:2.0:1790919201.615411:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 224: rc = 0 00100000:10000000:2.0:1790919201.616092:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 224: rc = 0 00100000:10000000:2.0:1790919201.616454:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 355: rc = 0 00100000:10000000:2.0:1790919201.617260:0:14422:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1790919201.617422:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 351: rc = 0 00100000:10000000:2.0:1790919201.617904:0:14422:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1790919201.617989:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 351: rc = 0 00100000:10000000:2.0:1790919201.618182:0:14422:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1790919201.618254:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 351: rc = 0 00100000:10000000:2.0:1790919201.618833:0:14422:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1790919201.618890:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 347: rc = 0 00100000:10000000:2.0:1790919201.619075:0:14422:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1790919201.619130:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 347: rc = 0 00100000:10000000:2.0:1790919201.619315:0:14422:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1790919201.619383:0:14422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 347: rc = 0 00000020:00000080:2.0:1790919201.619963:0:14422:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1790919201.619971:0:14422:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790919201.619980:0:14422:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3296956897c5235 00000020:01000004:2.0:1790919201.619987:0:14422:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1790919201.619992:0:14422:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1790919201.619997:0:14422:0:(tgt_mount.c:101:server_register_mount()) register mount ffff88beb3f1f800 from MGS 00000020:01000004:2.0:1790919201.620000:0:14422:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1790919201.620011:0:14422:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff88be88c74d40) 00000020:00000080:2.0:1790919201.620020:0:14422:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1790919201.620072:0:14422:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88beb3f1f800 from MGS, refs=2 00080000:01000000:2.0:1790919201.620077:0:14422:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790919201.620081:0:14422:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3296956897c5243 00000100:00100000:2.0:1790919201.620179:0:14422:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1790919201.620308:0:14422:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1790919201.620314:0:14422:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1790919201.621151:0:14422:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1790919201.621157:0:14422:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1790919201.622016:0:14422:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790919201.622194:0:14422:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1790919201.622200:0:14422:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1790919201.622767:0:14422:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1790919201.622776:0:14422:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1790919201.623053:0:14422:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1790919201.623059:0:14422:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1790919201.623511:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919201.623514:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919201.623516:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919201.623922:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919201.623924:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919201.623926:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919201.624339:0:14422:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1790919201.630755:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1790919201.634009:0:14422:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1790919201.634026:0:14422:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1790919201.634029:0:14422:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1790919201.635496:0:14431:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1790919201.635639:0:14422:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1790919201.635742:0:14422:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1790919201.636174:0:14422:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1790919201.636452:0:14422:0:(service.c:173:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790919201.636640:0:14422:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1790919201.636646:0:14422:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1790919201.637290:0:14422:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1790919201.637301:0:14422:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1790919201.637618:0:14422:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1790919201.637624:0:14422:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:2.0:1790919201.638625:0:14435:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:3.0:1790919201.639847:0:14422:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1790919201.639871:0:14422:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.127@tcp' 00000020:01000004:3.0:1790919201.639873:0:14422:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1790919201.639902:0:14422:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.127@tcp (typ=mgc) 00000020:00000080:3.0:1790919201.639925:0:14422:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.127@tcp (ffff88be88d30000) 00000020:00000080:3.0:1790919201.639944:0:14422:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1790919201.640025:0:14422:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88be9280b000@MGC192.168.201.127@tcp: add connection 192.168.201.127@tcp at head 00010000:00010000:3.0:1790919201.640165:0:14422:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.127@tcp-0 is initialized 00000040:01000000:3.0:1790919201.640172:0:14422:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.127@tcp ctxt 1 is initialized 10000000:01000000:3.0:1790919201.646858:0:14436:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1790919201.647032:0:14422:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.127@tcp (uuid 78fab146-b05d-43bc-9885-013f4b87a754) 00000020:00000080:2.0:1790919201.647063:0:14422:0:(genops.c:1384:class_connect()) connect: client 78fab146-b05d-43bc-9885-013f4b87a754, cookie 0xc3296956897c5251 00000100:00080000:2.0:1790919201.647079:0:14422:0:(import.c:545:import_select_connection()) MGC192.168.201.127@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790919201.647093:0:14422:0:(import.c:666:import_select_connection()) MGC192.168.201.127@tcp: import ffff88be9280b000 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:2.0:1790919201.647128:0:14422:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88bebf74df80 x1877914550359296/t0(0) o250->MGC192.168.201.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790919201.647160:0:14422:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 78fab146-b05d-43bc-9885-013f4b87a754->MGS 00000020:01000004:2.0:1790919201.647184:0:14422:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1790919201.647189:0:14422:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1790919201.647203:0:14422:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff88be88c73380) 00000020:00000080:2.0:1790919201.647215:0:14422:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1790919201.650117:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:78fab146-b05d-43bc-9885-013f4b87a754:3304:1877914550359296:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1790919201.650211:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919201.650299:0:14432:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550359296 00000100:00100000:3.0:1790919201.650308:0:14432:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550359296 00000100:00100000:3.0:1790919201.650347:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790919201.650355:0:14432:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3304:x1877914550359296:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1790919201.650383:0:14432:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 78fab146-b05d-43bc-9885-013f4b87a754@0@lo t0 exp 0000000000000000 cur 403 last 0 00000020:00000080:3.0:1790919201.650418:0:14432:0:(genops.c:1384:class_connect()) connect: client 78fab146-b05d-43bc-9885-013f4b87a754, cookie 0xc3296956897c525f 00000100:00080000:3.0:1790919201.650573:0:14432:0:(import.c:65:import_set_state_nolock()) ffff88be9280d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790919201.650623:0:14432:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78fab146-b05d-43bc-9885-013f4b87a754+5:3304:x1877914550359296:12345-0@lo:250:mount.lustre.0 Request processed in 268us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919201.650631:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790919201.650694:0:3304:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.127@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1790919201.650705:0:3304:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.201.127@tcp: connect to target with instance 0 00000100:00080000:3.0:1790919201.650714:0:3304:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.201.127@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1790919201.650719:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1790919201.650722:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88be9280b000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1790919201.650724:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1790919201.650733:0:3304:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1790919201.650738:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:78fab146-b05d-43bc-9885-013f4b87a754:3304:1877914550359296:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1790919201.661159:0:14422:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790919201.661397:0:14422:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1790919201.661404:0:14422:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1790919201.672874:0:14422:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1790919201.672893:0:14422:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1790919201.673370:0:14422:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1790919201.673376:0:14422:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1790919201.682330:0:14422:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790919201.682520:0:14422:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1790919201.682889:0:14422:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1790919201.683406:0:14422:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1790919201.683415:0:14422:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1790919201.722237:0:14422:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790919201.722431:0:14422:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1790919201.722438:0:14422:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1790919201.723724:0:14422:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1790919201.723734:0:14422:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1790919201.724260:0:14422:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790919201.724405:0:14422:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790919201.724410:0:14422:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1790919201.725087:0:14422:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790919201.725095:0:14422:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1790919201.725763:0:14422:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790919201.725977:0:14422:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790919201.725986:0:14422:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1790919201.726430:0:14422:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790919201.726436:0:14422:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1790919201.727037:0:14422:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790919201.727188:0:14422:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790919201.727193:0:14422:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1790919201.735173:0:14422:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790919201.735191:0:14422:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1790919201.769400:0:14422:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790919201.769797:0:14422:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1790919201.769805:0:14422:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1790919201.773056:0:14422:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1790919201.773071:0:14422:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1790919201.775330:0:14422:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1790919201.775351:0:14422:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1790919201.776416:0:14422:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1790919201.776441:0:14422:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1790919201.776448:0:14422:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.127@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1790919201.776739:0:14422:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.127@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790919201.776779:0:14422:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.127@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1790919201.776784:0:14422:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790919201.776785:0:14422:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790919201.776787:0:14422:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790919201.776788:0:14422:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790919201.776789:0:14422:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790919201.776791:0:14422:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790919201.776792:0:14422:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790919201.776793:0:14422:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790919201.776795:0:14422:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790919201.776796:0:14422:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790919201.776799:0:14422:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1790919201.776801:0:14422:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790919201.776803:0:14422:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790919201.776804:0:14422:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790919201.776810:0:14422:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790919201.776811:0:14422:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790919201.776812:0:14422:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790919201.776813:0:14422:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790919201.776814:0:14422:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790919201.776815:0:14422:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790919201.776816:0:14422:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790919201.776843:0:14422:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1790919201.776863:0:14422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf789180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:14422:1877914550359424:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790919201.776963:0:14422:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919201.777066:0:14422:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be85efbd80 going to sleep for 11 seconds 00000100:00100000:2.0:1790919201.777122:0:14434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550359424 00000100:00100000:2.0:1790919201.777130:0:14434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550359424 00000100:00100000:2.0:1790919201.777208:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790919201.777218:0:14434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+5:14422:x1877914550359424:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790919201.777267:0:14434:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1790919201.777270:0:14434:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1790919201.777272:0:14434:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1790919201.777599:0:14455:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1790919201.778038:0:14434:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1790919201.778960:0:14456:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1790919201.778967:0:14456:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1790919201.778970:0:14456:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1790919201.779002:0:14456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1790919201.779261:0:14434:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1790919201.779272:0:14434:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1790919201.787025:0:14434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+5:14422:x1877914550359424:12345-0@lo:253:mount.lustre.0 Request processed in 9797us (10050us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919201.787043:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790919201.787138:0:14422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf789180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:14422:1877914550359424:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790919201.787156:0:14422:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1790919201.787159:0:14422:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790919201.787161:0:14422:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790919201.787162:0:14422:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790919201.787163:0:14422:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790919201.787164:0:14422:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790919201.787166:0:14422:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790919201.787185:0:14422:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790919201.787186:0:14422:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790919201.787188:0:14422:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790919201.787189:0:14422:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790919201.787210:0:14422:0:(tgt_mount.c:101:server_register_mount()) register mount ffff88beb3f1f800 from lustre-MDT0000 10000000:01000000:2.0:1790919201.787243:0:14422:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1790919201.787247:0:14422:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1790919201.787252:0:14422:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff88be88d30000 10000000:01000000:2.0:1790919201.787257:0:14422:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790919201.787266:0:14422:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff88be88d30000 from 1 10000000:01000000:2.0:1790919201.787270:0:14422:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790919201.787312:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be90f9ea00/0xc3296956897c5266 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919201.787324:0:14422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88be90f9ea00/0xc3296956897c5266 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919201.787334:0:14422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88be90f9ea00/0xc3296956897c5266 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919201.787354:0:14422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:14422:1877914550359552:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790919201.787388:0:14422:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919201.787464:0:14422:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beba0d9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790919201.787511:0:14433:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550359552 00000100:00100000:0.0:1790919201.787517:0:14433:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550359552 00000100:00100000:0.0:1790919201.787764:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790919201.787773:0:14433:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+5:14422:x1877914550359552:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790919201.787786:0:14433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919201.787800:0:14433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88bebac58c00/0xc3296956897c526d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c5266 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919201.787822:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88bebac58c00/0xc3296956897c526d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c5266 expref: 6 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919201.787832:0:14433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88bebac58c00/0xc3296956897c526d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c5266 expref: 6 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919201.787840:0:14433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac58c00, rc 0) 00000100:00100000:0.0:1790919201.787876:0:14433:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+6:14422:x1877914550359552:12345-0@lo:101:mount.lustre.0 Request processed in 105us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919201.787882:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790919201.787945:0:14422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:14422:1877914550359552:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790919201.787957:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88be90f9ea00/0xc3296956897c5266 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c526d expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919201.787966:0:14422:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88be90f9ea00/0xc3296956897c5266 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c526d expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919201.788003:0:14422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:14422:1877914550359680:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790919201.788033:0:14422:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919201.788153:0:14422:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beba0d9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790919201.788187:0:14432:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550359680 00000100:00100000:3.0:1790919201.788191:0:14432:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550359680 00000100:00100000:1.0:1790919201.788231:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790919201.788240:0:14434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+6:14422:x1877914550359680:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790919201.788463:0:14434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+6:14422:x1877914550359680:12345-0@lo:501:mount.lustre.0 Request processed in 224us (428us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790919201.788475:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790919201.788562:0:14422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:14422:1877914550359680:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1790919201.788584:0:14422:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1790919201.788598:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be90f9ea00/0xc3296956897c5266 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c526d expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919201.788607:0:14422:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88be90f9ea00/0xc3296956897c5266 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c526d expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919201.788616:0:14422:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff88beb3f1f800 10000000:01000000:2.0:1790919201.788620:0:14422:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1790919201.788623:0:14422:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff88beb3f1f800 10000000:01000000:2.0:1790919201.788625:0:14422:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1790919201.788628:0:14422:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff88beb3f1f800 from 1 10000000:01000000:2.0:1790919201.788631:0:14422:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1790919201.788646:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be90f9e600/0xc3296956897c5274 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919201.788666:0:14422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88be90f9e600/0xc3296956897c5274 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919201.788674:0:14422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88be90f9e600/0xc3296956897c5274 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919201.788687:0:14422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:14422:1877914550359808:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790919201.788712:0:14422:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919201.788724:0:14422:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beba0d9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790919201.788834:0:14434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550359808 00000100:00100000:1.0:1790919201.788839:0:14434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550359808 00000100:00100000:1.0:1790919201.788855:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790919201.788860:0:14434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+6:14422:x1877914550359808:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790919201.788867:0:14434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919201.788876:0:14434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88beb3f7f400/0xc3296956897c527b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c5274 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919201.788891:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88beb3f7f400/0xc3296956897c527b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c5274 expref: 7 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919201.788899:0:14434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88beb3f7f400/0xc3296956897c527b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c5274 expref: 7 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919201.788919:0:14434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88beb3f7f400, rc 0) 00000100:00100000:1.0:1790919201.788950:0:14434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+7:14422:x1877914550359808:12345-0@lo:101:mount.lustre.0 Request processed in 89us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919201.788956:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790919201.789016:0:14422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:14422:1877914550359808:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790919201.789034:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88be90f9e600/0xc3296956897c5274 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c527b expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919201.789042:0:14422:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88be90f9e600/0xc3296956897c5274 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c527b expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919201.789053:0:14422:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1790919201.789066:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be90f9e600/0xc3296956897c5274 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c527b expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919201.789073:0:14422:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88be90f9e600/0xc3296956897c5274 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c527b expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919201.789078:0:14422:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1790919201.789082:0:14422:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790919201.789085:0:14422:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff88beb3f1f800 10000000:01000000:2.0:1790919201.789088:0:14422:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1790919201.789091:0:14422:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1790919201.789092:0:14422:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1790919201.789106:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be90f9e400/0xc3296956897c5282 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919201.789113:0:14422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88be90f9e400/0xc3296956897c5282 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919201.789121:0:14422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88be90f9e400/0xc3296956897c5282 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919201.789133:0:14422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:14422:1877914550359936:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790919201.789166:0:14422:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919201.789184:0:14422:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beba0d9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790919201.789243:0:14433:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550359936 00000100:00100000:0.0:1790919201.789247:0:14433:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550359936 00000100:00100000:0.0:1790919201.789267:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790919201.789274:0:14433:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+7:14422:x1877914550359936:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790919201.789281:0:14433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919201.789289:0:14433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88bebac59600/0xc3296956897c5289 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c5282 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919201.789301:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88bebac59600/0xc3296956897c5289 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c5282 expref: 8 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919201.789309:0:14433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88bebac59600/0xc3296956897c5289 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c5282 expref: 8 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919201.789325:0:14433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac59600, rc 0) 00000100:00100000:0.0:1790919201.789366:0:14433:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+8:14422:x1877914550359936:12345-0@lo:101:mount.lustre.0 Request processed in 92us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919201.789371:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790919201.789446:0:14422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:14422:1877914550359936:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790919201.789456:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88be90f9e400/0xc3296956897c5282 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c5289 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919201.789463:0:14422:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88be90f9e400/0xc3296956897c5282 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c5289 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919201.789497:0:14422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:14422:1877914550360064:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790919201.789519:0:14422:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919201.789557:0:14422:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beba0d9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790919201.789621:0:14434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550360064 00000100:00100000:1.0:1790919201.789626:0:14434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550360064 00000100:00100000:1.0:1790919201.789644:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790919201.789660:0:14434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+8:14422:x1877914550360064:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790919201.789954:0:14434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+9:14422:x1877914550360064:12345-0@lo:501:mount.lustre.0 Request processed in 304us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919201.789961:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790919201.790083:0:14422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:14422:1877914550360064:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790919201.790112:0:14422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:14422:1877914550360192:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790919201.790146:0:14422:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919201.790171:0:14422:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beba0d9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790919201.790242:0:14433:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550360192 00000100:00100000:0.0:1790919201.790247:0:14433:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550360192 00000100:00100000:0.0:1790919201.790266:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790919201.790271:0:14433:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+9:14422:x1877914550360192:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790919201.790560:0:14433:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+9:14422:x1877914550360192:12345-0@lo:503:mount.lustre.0 Request processed in 288us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919201.790567:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790919201.790647:0:14422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:14422:1877914550360192:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790919201.791296:0:14457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:78fab146-b05d-43bc-9885-013f4b87a754:14457:1877914550360320:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790919201.791336:0:14457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919201.791365:0:14457:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beba0d9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790919201.791409:0:14433:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550360320 00000100:00100000:0.0:1790919201.791414:0:14433:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550360320 00000100:00100000:0.0:1790919201.791434:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790919201.791440:0:14433:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+9:14457:x1877914550360320:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790919201.791772:0:14433:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+9:14457:x1877914550360320:12345-0@lo:502:llog_process_th.0 Request processed in 331us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919201.791779:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790919201.791819:0:14457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:78fab146-b05d-43bc-9885-013f4b87a754:14457:1877914550360320:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790919201.791839:0:14457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790919201.791848:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919201.791851:0:14457:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1790919201.791855:0:14457:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1790919201.791858:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790919201.791872:0:14457:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff88be871699c0) 00000020:00000080:0.0:1790919201.791891:0:14457:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1790919201.791896:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1790919201.791966:0:14457:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:0.0:1790919201.791972:0:14457:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3296956897c5297 00000020:00000080:0.0:1790919201.792157:0:14457:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1790919201.792161:0:14457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790919201.792164:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919201.792166:0:14457:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1790919201.792168:0:14457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790919201.792172:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919201.792173:0:14457:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1790919201.792176:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790919201.792183:0:14457:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff88be87168000) 00000020:00000080:0.0:1790919201.792192:0:14457:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1790919201.792196:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1790919201.792198:0:14457:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1790919201.792201:0:14457:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1790919201.792206:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1790919201.792244:0:14457:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88beb3f1f800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1790919201.792256:0:14457:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff88be8716cd40) 00000020:00000080:0.0:1790919201.792264:0:14457:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1790919201.792309:0:14457:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1790919201.792314:0:14457:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3296956897c52ac 00000020:00000080:0.0:1790919201.792400:0:14457:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1790919201.792405:0:14457:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1790919201.792409:0:14457:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc3296956897c52b3 00080000:01000000:0.0:1790919201.792413:0:14457:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:0.0:1790919201.792416:0:14457:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3296956897c52ba 00010000:00010000:1.0:1790919201.861319:0:14457:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1790919201.861988:0:14457:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:1.0:1790919201.862160:0:14457:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1790919201.862725:0:14457:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff88bebaa33380) 00000020:00000080:1.0:1790919201.862742:0:14457:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1790919201.862799:0:14457:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:1.0:1790919201.862805:0:14457:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3296956897c52c8 00000020:00000080:1.0:1790919201.863416:0:14457:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1790919201.872740:0:14457:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc3296956897c52cf 00000020:00000080:3.0:1790919201.877979:0:14457:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1790919201.877991:0:14457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790919201.877999:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919201.878000:0:14457:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1790919201.878005:0:14457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790919201.878010:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919201.878012:0:14457:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1790919201.878016:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1790919201.878059:0:14457:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1790919201.878073:0:14457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790919201.878077:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919201.878078:0:14457:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1790919201.878081:0:14457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1790919201.878083:0:14457:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1790919201.878085:0:14457:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790919201.878086:0:14457:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790919201.878088:0:14457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1790919201.878090:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919201.878104:0:14457:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1790919201.878108:0:14457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790919201.878112:0:14457:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1790919201.878115:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919201.878117:0:14457:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1790919201.878119:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790919201.878125:0:14457:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.127@tcp to nid 0x20000c0a8c97f (192.168.201.127@tcp) 00000020:01000000:3.0:1790919201.878380:0:14457:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1790919201.878384:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790919201.878400:0:14457:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff88be88d34d40) 00000020:00000080:3.0:1790919201.878418:0:14457:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1790919201.878422:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790919201.878481:0:14457:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1790919201.878487:0:14457:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1790919201.878494:0:14457:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3296956897c52dd 00010000:00080000:3.0:1790919201.878598:0:14457:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88be9280c000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.127@tcp at head 00010000:00010000:3.0:1790919201.878830:0:14457:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1790919201.879396:0:14457:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1790919201.879446:0:14457:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1790919201.881754:0:14457:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790919201.881812:0:14457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1790919201.881871:0:14457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1790919201.882284:0:14461:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1790919201.882290:0:14461:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1790919201.882954:0:14457:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790919201.882966:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1790919201.882996:0:14457:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1790919201.883015:0:14457:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3296956897c52e4 00000100:00080000:3.0:1790919201.883027:0:14457:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790919201.883041:0:14457:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff88be9280c000 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:3.0:1790919201.883079:0:14457:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88bebf78a680 x1877914550360448/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790919201.883108:0:14457:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1790919201.883177:0:14457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790919201.883180:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919201.883182:0:14457:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1790919201.883185:0:14457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1790919201.883188:0:14457:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1790919201.883190:0:14457:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790919201.883191:0:14457:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790919201.883193:0:14457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1790919201.883195:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919201.883196:0:14457:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1790919201.883199:0:14457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790919201.883202:0:14457:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1790919201.883205:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919201.883206:0:14457:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1790919201.883209:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790919201.883212:0:14457:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.127@tcp to nid 0x20000c0a8c97f (192.168.201.127@tcp) 00000020:01000000:3.0:1790919201.883230:0:14457:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1790919201.883232:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790919201.883244:0:14457:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff88be88d33380) 00000020:00000080:3.0:1790919201.883255:0:14457:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1790919201.883258:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790919201.883306:0:14457:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1790919201.883311:0:14457:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1790919201.883315:0:14457:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3296956897c52f2 00010000:00080000:3.0:1790919201.883339:0:14457:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88be92816000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.127@tcp at head 00000100:00100000:1.0:1790919201.883625:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf78a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1877914550360448:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1790919201.883691:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877914550360448 offset 0 length 520: 4 00010000:00010000:3.0:1790919201.883889:0:14457:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1790919201.884090:0:14457:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1790919201.884117:0:14457:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1790919201.885110:0:14457:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790919201.885313:0:14457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1790919201.885396:0:14457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1790919201.885831:0:14463:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1790919201.885836:0:14463:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1790919201.886466:0:14457:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790919201.886478:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1790919201.886518:0:14457:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1790919201.886716:0:14457:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3296956897c52f9 00000100:00080000:3.0:1790919201.886725:0:14457:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790919201.886736:0:14457:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88be92816000 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:3.0:1790919201.886770:0:14457:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88bebf78b480 x1877914550360576/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790919201.886818:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf78b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1877914550360576:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1790919201.886864:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877914550360576 offset 0 length 520: 4 00000100:00080000:3.0:1790919201.886924:0:14457:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1790919201.886977:0:14457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790919201.886981:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919201.886983:0:14457:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1790919201.886985:0:14457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790919201.886989:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919201.886990:0:14457:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790919201.886993:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790919201.886995:0:14457:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1790919201.886997:0:14457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790919201.886999:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919201.887001:0:14457:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1790919201.887003:0:14457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790919201.887005:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919201.887006:0:14457:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1790919201.887010:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1790919201.887036:0:14457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf788e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:78fab146-b05d-43bc-9885-013f4b87a754:14457:1877914550360704:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790919201.887080:0:14457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919201.887106:0:14434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550360704 00000100:00100000:3.0:1790919201.887112:0:14434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550360704 00000100:00100000:3.0:1790919201.887141:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790919201.887149:0:14434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+9:14457:x1877914550360704:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790919201.887356:0:14434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+9:14457:x1877914550360704:12345-0@lo:502:llog_process_th.0 Request processed in 207us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919201.887373:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790919201.887419:0:14457:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be85efb240 going to sleep for 11 seconds 00000100:00100000:3.0:1790919201.887439:0:14457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf788e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:78fab146-b05d-43bc-9885-013f4b87a754:14457:1877914550360704:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790919201.887465:0:14457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790919201.887469:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919201.887471:0:14457:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1790919201.887475:0:14457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1790919201.887711:0:14422:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1790919201.887728:0:14422:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1790919201.887750:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be90f9e400/0xc3296956897c5282 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c5289 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919201.887771:0:14422:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88be90f9e400/0xc3296956897c5282 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c5289 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919201.887779:0:14422:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88beb3f1f800 from 1 10000000:01000000:0.0:1790919201.887782:0:14422:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790919201.887808:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88bebac58400/0xc3296956897c5300 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919201.887816:0:14422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88bebac58400/0xc3296956897c5300 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919201.887825:0:14422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88bebac58400/0xc3296956897c5300 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919201.887838:0:14422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac5e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:14422:1877914550360832:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790919201.887866:0:14422:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919201.887955:0:14422:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be85e0af00 going to sleep for 11 seconds 00000100:00100000:2.0:1790919201.888084:0:14433:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550360832 00000100:00100000:2.0:1790919201.888088:0:14433:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550360832 00000100:00100000:2.0:1790919201.888142:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790919201.888149:0:14433:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+9:14422:x1877914550360832:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790919201.888158:0:14433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919201.888178:0:14433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be90f9e800/0xc3296956897c5307 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c5300 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919201.888199:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be90f9e800/0xc3296956897c5307 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c5300 expref: 10 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919201.888210:0:14433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be90f9e800/0xc3296956897c5307 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c5300 expref: 10 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919201.888218:0:14433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be90f9e800, rc 0) 00000100:00100000:2.0:1790919201.888263:0:14433:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+10:14422:x1877914550360832:12345-0@lo:101:mount.lustre.0 Request processed in 115us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919201.888269:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790919201.888329:0:14422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac5e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:14422:1877914550360832:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790919201.888340:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88bebac58400/0xc3296956897c5300 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c5307 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919201.888349:0:14422:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88bebac58400/0xc3296956897c5300 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c5307 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919201.888878:0:14422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac5e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:14422:1877914550360960:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1790919201.888925:0:14422:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919201.889072:0:14422:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be85e0af00 going to sleep for 11 seconds 00000100:00100000:3.0:1790919201.889209:0:14434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550360960 00000100:00100000:3.0:1790919201.889215:0:14434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550360960 00000100:00100000:3.0:1790919201.889240:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790919201.889247:0:14434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+10:14422:x1877914550360960:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1790919201.889264:0:14434:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1790919201.889270:0:14434:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1790919201.889345:0:14434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+10:14422:x1877914550360960:12345-0@lo:256:mount.lustre.0 Request processed in 98us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919201.889352:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790919201.889428:0:14422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac5e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:14422:1877914550360960:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1790919201.889985:0:14422:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790919201.890000:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88bebac58400/0xc3296956897c5300 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c5307 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919201.890009:0:14422:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88bebac58400/0xc3296956897c5300 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c5307 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919201.890017:0:14422:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88beb3f1f800 from 1 10000000:01000000:0.0:1790919201.890020:0:14422:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790919201.890046:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88bebac59400/0xc3296956897c530e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919201.890054:0:14422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88bebac59400/0xc3296956897c530e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919201.890063:0:14422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88bebac59400/0xc3296956897c530e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919201.890078:0:14422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac5e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:14422:1877914550361088:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790919201.890113:0:14422:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919201.890134:0:14422:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be85e0af00 going to sleep for 11 seconds 00000100:00100000:3.0:1790919201.890220:0:14434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550361088 00000100:00100000:3.0:1790919201.890226:0:14434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550361088 00000100:00100000:3.0:1790919201.890249:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790919201.890256:0:14434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+10:14422:x1877914550361088:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790919201.890265:0:14434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919201.890279:0:14434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be813a2400/0xc3296956897c5315 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c530e expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919201.890298:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be813a2400/0xc3296956897c5315 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c530e expref: 11 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919201.890308:0:14434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be813a2400/0xc3296956897c5315 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c530e expref: 11 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919201.890327:0:14434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be813a2400, rc 0) 00000100:00100000:3.0:1790919201.890368:0:14434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+11:14422:x1877914550361088:12345-0@lo:101:mount.lustre.0 Request processed in 113us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919201.890374:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790919201.890456:0:14422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac5e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:14422:1877914550361088:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790919201.890468:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88bebac59400/0xc3296956897c530e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c5315 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919201.890476:0:14422:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88bebac59400/0xc3296956897c530e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c5315 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919201.890558:0:14422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac5e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:14422:1877914550361216:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790919201.890581:0:14422:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919201.890600:0:14422:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be85e0af00 going to sleep for 11 seconds 00000100:00100000:3.0:1790919201.890645:0:14434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550361216 00000100:00100000:3.0:1790919201.890649:0:14434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550361216 00000100:00100000:3.0:1790919201.890664:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790919201.890670:0:14434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+11:14422:x1877914550361216:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790919201.891029:0:14434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+11:14422:x1877914550361216:12345-0@lo:501:mount.lustre.0 Request processed in 358us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919201.891036:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790919201.891096:0:14422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac5e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:14422:1877914550361216:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790919201.891123:0:14422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac5e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:14422:1877914550361344:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790919201.891156:0:14422:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919201.891175:0:14422:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be85e0af00 going to sleep for 11 seconds 00000100:00100000:3.0:1790919201.891216:0:14434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550361344 00000100:00100000:3.0:1790919201.891221:0:14434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550361344 00000100:00100000:3.0:1790919201.891239:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790919201.891244:0:14434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+11:14422:x1877914550361344:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790919201.891379:0:14434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+11:14422:x1877914550361344:12345-0@lo:503:mount.lustre.0 Request processed in 133us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919201.891385:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790919201.891456:0:14422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac5e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:14422:1877914550361344:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790919201.891759:0:14465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf788e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:78fab146-b05d-43bc-9885-013f4b87a754:14465:1877914550361472:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790919201.891793:0:14465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919201.891813:0:14465:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be85efb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919201.891849:0:14434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550361472 00000100:00100000:0.0:1790919201.891853:0:14434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550361472 00000100:00100000:0.0:1790919201.891870:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790919201.891875:0:14434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+11:14465:x1877914550361472:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790919201.892058:0:14434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+11:14465:x1877914550361472:12345-0@lo:502:llog_process_th.0 Request processed in 182us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919201.892065:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790919201.892129:0:14465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf788e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:78fab146-b05d-43bc-9885-013f4b87a754:14465:1877914550361472:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790919201.892149:0:14465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790919201.892157:0:14465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919201.892164:0:14465:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790919201.892171:0:14465:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88beb3f1f800 00000020:00000080:3.0:1790919201.892173:0:14465:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790919201.892183:0:14465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790919201.892185:0:14465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919201.892186:0:14465:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1790919201.892188:0:14465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790919201.892191:0:14465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919201.892192:0:14465:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1790919201.892195:0:14465:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88beb3f1f800 00000020:00000080:3.0:1790919201.892197:0:14465:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790919201.892258:0:14465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790919201.892262:0:14465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919201.892263:0:14465:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1790919201.892266:0:14465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790919201.892268:0:14465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919201.892270:0:14465:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790919201.892273:0:14465:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff88beb3f1f800 00000020:00000080:3.0:1790919201.892275:0:14465:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790919201.892308:0:14465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf788e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:78fab146-b05d-43bc-9885-013f4b87a754:14465:1877914550361600:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790919201.892338:0:14465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919201.892350:0:14465:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bebf6ac840 going to sleep for 11 seconds 00000100:00100000:0.0:1790919201.895377:0:14434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550361600 00000100:00100000:0.0:1790919201.895393:0:14434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550361600 00000100:00100000:0.0:1790919201.895437:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790919201.895445:0:14434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+11:14465:x1877914550361600:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790919201.895699:0:14434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+11:14465:x1877914550361600:12345-0@lo:502:llog_process_th.0 Request processed in 253us (3358us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919201.895706:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790919201.895763:0:14465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf788e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:78fab146-b05d-43bc-9885-013f4b87a754:14465:1877914550361600:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790919201.895796:0:14465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790919201.895803:0:14465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919201.895805:0:14465:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1790919201.895810:0:14465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1790919201.895864:0:14422:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1790919201.895884:0:14422:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790919201.895898:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88bebac59400/0xc3296956897c530e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c5315 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919201.905114:0:14422:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88bebac59400/0xc3296956897c530e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c5315 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919201.905208:0:14422:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790919201.905212:0:14422:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff88beb3f1f800 10000000:01000000:0.0:1790919201.905215:0:14422:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff88beb3f1f800 10000000:01000000:0.0:1790919201.905218:0:14422:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790919201.905224:0:14422:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88beb3f1f800 from 1 10000000:01000000:0.0:1790919201.905227:0:14422:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790919201.905262:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88bebac58e00/0xc3296956897c531c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919201.905272:0:14422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88bebac58e00/0xc3296956897c531c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919201.905283:0:14422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88bebac58e00/0xc3296956897c531c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919201.905306:0:14422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac5e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:14422:1877914550361728:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790919201.905365:0:14422:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919201.905412:0:14422:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be88d42840 going to sleep for 11 seconds 00000100:00100000:1.0:1790919201.905568:0:14434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550361728 00000100:00100000:1.0:1790919201.905575:0:14434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550361728 00000100:00100000:1.0:1790919201.905613:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790919201.905621:0:14434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+11:14422:x1877914550361728:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790919201.905634:0:14434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919201.905645:0:14434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88beb3f7f000/0xc3296956897c5323 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c531c expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919201.905666:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88beb3f7f000/0xc3296956897c5323 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c531c expref: 12 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919201.905676:0:14434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88beb3f7f000/0xc3296956897c5323 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c531c expref: 12 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919201.905696:0:14434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88beb3f7f000, rc 0) 00000100:00100000:1.0:1790919201.905736:0:14434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+12:14422:x1877914550361728:12345-0@lo:101:mount.lustre.0 Request processed in 115us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919201.905743:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790919201.905865:0:14422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac5e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:14422:1877914550361728:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790919201.905880:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88bebac58e00/0xc3296956897c531c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c5323 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919201.905888:0:14422:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88bebac58e00/0xc3296956897c531c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c5323 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919201.905943:0:14422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac5e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:14422:1877914550361856:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790919201.905966:0:14422:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919201.905981:0:14422:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be88d42840 going to sleep for 11 seconds 00000100:00100000:1.0:1790919201.906027:0:14432:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550361856 00000100:00100000:1.0:1790919201.906032:0:14432:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550361856 00000100:00100000:1.0:1790919201.906058:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790919201.906064:0:14432:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78fab146-b05d-43bc-9885-013f4b87a754+12:14422:x1877914550361856:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790919201.906295:0:14432:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78fab146-b05d-43bc-9885-013f4b87a754+12:14422:x1877914550361856:12345-0@lo:501:mount.lustre.0 Request processed in 231us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919201.906302:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790919201.906369:0:14422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac5e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:14422:1877914550361856:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790919201.906395:0:14422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac5e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:14422:1877914550361984:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790919201.906429:0:14422:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919201.906449:0:14422:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be88d42840 going to sleep for 11 seconds 00000100:00100000:1.0:1790919201.906490:0:14433:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550361984 00000100:00100000:1.0:1790919201.906494:0:14433:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550361984 00000100:00100000:1.0:1790919201.906520:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790919201.906546:0:14433:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+12:14422:x1877914550361984:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790919201.906677:0:14433:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+12:14422:x1877914550361984:12345-0@lo:503:mount.lustre.0 Request processed in 150us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919201.906684:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790919201.910056:0:14422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac5e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:14422:1877914550361984:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790919201.910444:0:14470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b39500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:78fab146-b05d-43bc-9885-013f4b87a754:14470:1877914550362112:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790919201.910517:0:14470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919201.910574:0:14470:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be88cb43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919201.910656:0:14434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550362112 00000100:00100000:0.0:1790919201.910663:0:14434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550362112 00000100:00100000:0.0:1790919201.910701:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790919201.910710:0:14434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+12:14470:x1877914550362112:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790919201.910944:0:14434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+12:14470:x1877914550362112:12345-0@lo:502:llog_process_th.0 Request processed in 235us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919201.910952:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790919201.910995:0:14470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b39500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:78fab146-b05d-43bc-9885-013f4b87a754:14470:1877914550362112:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1790919201.911049:0:14470:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1790919201.911064:0:14470:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff88be8716b380) 00000020:00000080:0.0:1790919201.911089:0:14470:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1790919201.911159:0:14470:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88beb3f1f800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1790919201.911163:0:14470:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88beb3f1f800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1790919201.911165:0:14470:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88beb3f1f800 4 00010000:00080000:0.0:1790919201.911193:0:14470:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88be87132800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.127@tcp at head 00010000:00010000:0.0:1790919201.912760:0:14470:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1790919201.915620:0:14470:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1790919201.915659:0:14470:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790919201.915671:0:14470:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc3296956897c5331 00000100:00080000:1.0:1790919201.915681:0:14470:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790919201.915700:0:14470:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff88be87132800 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:1.0:1790919201.915735:0:14470:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88beb3b38000 x1877914550362240/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790919201.915760:0:14470:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1790919201.915872:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877914550362240:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790919201.915951:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919201.921112:0:14470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf788380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:78fab146-b05d-43bc-9885-013f4b87a754:14470:1877914550362368:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790919201.921185:0:14470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919201.921220:0:14470:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be90090cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790919201.921451:0:14439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550362240 00000100:00100000:1.0:1790919201.921459:0:14439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550362240 00000100:00100000:1.0:1790919201.921486:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790919201.921493:0:14439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf788a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1877914550362240:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790919201.921565:0:14439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf788a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1877914550362240:12345-0@lo:38:llog_process_th.0 Request processed in 70us (5613us total) trans 0 rc -11/-11 00000100:00100000:1.0:1790919201.921571:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790919201.922134:0:14432:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550362368 00000100:00100000:0.0:1790919201.922140:0:14432:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550362368 00000100:00100000:0.0:1790919201.922212:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790919201.922221:0:14432:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78fab146-b05d-43bc-9885-013f4b87a754+12:14470:x1877914550362368:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790919201.922569:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790919201.922578:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88be87132800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790919201.922583:0:3304:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1790919201.922593:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877914550362240:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790919201.926000:0:14432:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78fab146-b05d-43bc-9885-013f4b87a754+12:14470:x1877914550362368:12345-0@lo:502:llog_process_th.0 Request processed in 3773us (4808us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919201.926015:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790919201.926228:0:14470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf788380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:78fab146-b05d-43bc-9885-013f4b87a754:14470:1877914550362368:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1790919201.926268:0:14470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1790919201.926403:0:14422:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1790919201.926430:0:14422:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790919201.926454:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88bebac58e00/0xc3296956897c531c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c5323 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919201.926466:0:14422:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88bebac58e00/0xc3296956897c531c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c5323 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790919201.926510:0:14422:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1790919201.926512:0:14422:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790919201.926514:0:14422:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790919201.926515:0:14422:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790919201.926516:0:14422:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790919201.926517:0:14422:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790919201.926519:0:14422:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790919201.926520:0:14422:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790919201.926522:0:14422:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790919201.926546:0:14422:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790919201.926549:0:14422:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1790919201.926551:0:14422:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790919201.926557:0:14422:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790919201.926558:0:14422:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790919201.926559:0:14422:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790919201.926560:0:14422:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790919201.926561:0:14422:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790919201.926562:0:14422:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790919201.926563:0:14422:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790919201.926564:0:14422:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790919201.926565:0:14422:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790919201.926585:0:14422:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1790919201.926599:0:14422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b3a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:14422:1877914550362496:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1790919201.926657:0:14422:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919201.926687:0:14422:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be88cb4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790919201.926704:0:14433:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550362496 00000100:00100000:1.0:1790919201.926710:0:14433:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550362496 00000100:00100000:1.0:1790919201.926743:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790919201.926750:0:14433:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+12:14422:x1877914550362496:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790919201.926773:0:14433:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1790919201.926785:0:14433:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1790919201.963999:0:14433:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790919201.964018:0:14433:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1790919201.964125:0:14455:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790919201.964130:0:14455:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790919201.964153:0:14455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88be90f9f000/0xc3296956897c5338 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919201.964172:0:14455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88be90f9e800/0xc3296956897c5307 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c5300 expref: 12 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919201.964180:0:14455:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88be90f9f000/0xc3296956897c5338 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919201.964219:0:14455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88be90f9e800/0xc3296956897c5307 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3296956897c5300 expref: 12 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919201.964233:0:14455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88be90f9e800/0xc3296956897c5307 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3296956897c5300 expref: 12 pid: 14433 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919201.964263:0:14455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14455:1877914550362624:0@lo:104: 00000100:00100000:2.0:1790919201.964327:0:14455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919201.964369:0:14455:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beba0d99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919201.964482:0:14423:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550362624 00000100:00100000:0.0:1790919201.964490:0:14423:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550362624 00000100:00100000:0.0:1790919201.964556:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790919201.964565:0:14423:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:78fab146-b05d-43bc-9885-013f4b87a754+3:14455:x1877914550362624:12345-0@lo:104: 00010000:00010000:0.0:1790919201.964578:0:14423:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.127@tcp lock: ffff88bebac58400/0xc3296956897c5300 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c5307 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919201.964623:0:14423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790919201.964629:0:14423:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:78fab146-b05d-43bc-9885-013f4b87a754+3:14455:x1877914550362624:12345-0@lo:104: Request processed in 66us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919201.964635:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1790919201.964744:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919201.964750:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff88bebac58400/0xc3296956897c5300 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c5307 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919201.964758:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac58400 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:2.0:1790919201.964763:0:14429:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff88bebac58400/0xc3296956897c5300 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3296956897c5307 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919201.964771:0:14429:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff88bebac58400/0xc3296956897c5300 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3296956897c5307 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790919201.964779:0:14429:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff88bebac58400/0xc3296956897c5300 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3296956897c5307 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919201.964785:0:14429:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790919201.964815:0:14429:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff88bebac58400/0xc3296956897c5300 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c5307 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919201.964821:0:14429:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790919201.964841:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff88bebac58400/0xc3296956897c5300 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c5307 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919201.964848:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff88bebac58400/0xc3296956897c5300 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c5307 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919201.964864:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919201.964871:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919201.964873:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919201.964894:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:78fab146-b05d-43bc-9885-013f4b87a754:3306:1877914550362752:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790919201.964934:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919201.964999:0:14425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550362752 00000100:00100000:2.0:1790919201.965004:0:14425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550362752 00010000:00010000:2.0:1790919201.965023:0:14425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88be90f9e800/0xc3296956897c5307 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c5300 expref: 13 pid: 14433 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919201.965045:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790919201.965052:0:14425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78fab146-b05d-43bc-9885-013f4b87a754+13:3306:x1877914550362752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790919201.965062:0:14425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919201.965067:0:14425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88be90f9e800/0xc3296956897c5307 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c5300 expref: 13 pid: 14433 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919201.965077:0:14425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88be90f9e800/0xc3296956897c5307 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3296956897c5300 expref: 13 pid: 14433 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919201.965092:0:14425:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88be90f9f000/0xc3296956897c5338 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919201.965100:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be90f9f000/0xc3296956897c5338 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790919201.965113:0:14425:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000984063s 00010000:00010000:2.0:1790919201.965118:0:14425:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88be90f9f000/0xc3296956897c5338 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919201.965125:0:14425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88be90f9f000/0xc3296956897c5338 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919201.965142:0:14425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88be90f9f000/0xc3296956897c5338 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919201.965149:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88be90f9f000/0xc3296956897c5338 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919201.965154:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be90f9f000 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:2.0:1790919201.965158:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88be90f9f000/0xc3296956897c5338 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919201.965166:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88be90f9f000/0xc3296956897c5338 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919201.965175:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88be90f9f000/0xc3296956897c5338 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919201.965184:0:14425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919201.965214:0:14425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78fab146-b05d-43bc-9885-013f4b87a754+13:3306:x1877914550362752:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919201.965221:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790919201.965259:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:78fab146-b05d-43bc-9885-013f4b87a754:3306:1877914550362752:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790919201.965286:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be90f9e800/0xc3296956897c5307 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3296956897c5300 expref: 12 pid: 14433 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919201.965295:0:14455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14455:1877914550362624:0@lo:104: 00010000:00010000:2.0:1790919201.965306:0:14455:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88be90f9f000/0xc3296956897c5338 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919201.965323:0:14455:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88be90f9f000/0xc3296956897c5338 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919201.965330:0:14455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88be90f9f000/0xc3296956897c5338 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919201.965337:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be90f9f000/0xc3296956897c5338 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919201.971685:0:14433:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+11:14422:x1877914550362496:12345-0@lo:253:mount.lustre.0 Request processed in 44926us (45019us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919201.971700:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790919201.971837:0:14422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b3a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:14422:1877914550362496:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790919201.971853:0:14422:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1790919201.971857:0:14422:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790919201.971859:0:14422:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790919201.971860:0:14422:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790919201.971862:0:14422:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790919201.971863:0:14422:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790919201.971864:0:14422:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790919201.971866:0:14422:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790919201.971867:0:14422:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790919201.971869:0:14422:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790919201.971870:0:14422:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790919201.971883:0:14422:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1790919201.975482:0:14422:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1790919201.976066:0:14422:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1790919201.976328:0:14422:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1790919201.976478:0:14422:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1790919201.976924:0:14422:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1790919201.977063:0:14422:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1790919201.977868:0:14422:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1790919201.978018:0:14422:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1790919201.978253:0:14422:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1790919201.978462:0:14422:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1790919201.979011:0:14422:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1790919201.979150:0:14422:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1790919201.997207:0:14422:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1790919201.997576:0:14422:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1790919201.997835:0:14477:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1790919201.997840:0:14477:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1790919201.998276:0:14478:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1790919201.998356:0:14478:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790919202.000737:0:14478:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1790919202.000824:0:14478:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1790919202.000842:0:14478:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1790919202.002694:0:14422:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1790919202.002822:0:14422:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1790919202.003273:0:14422:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1790919202.003281:0:14422:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1790919202.003415:0:14422:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790919202.005105:0:14422:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1790919202.005995:0:14422:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1790919202.006056:0:14422:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1790919202.008224:0:14422:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1790919202.013181:0:14422:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1790919202.044083:0:14422:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1790919202.044126:0:14422:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9f1700e33988 00100000:10000000:2.0:1790919202.044134:0:14422:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1790919202.045094:0:14422:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790919202.045111:0:14422:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.127@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790919202.045127:0:14422:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1790919202.045154:0:14422:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1790919202.687852:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790919202.815626:0:14436:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790919202.815634:0:14436:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88beb3f1f800 from 6 10000000:01000000:2.0:1790919202.815638:0:14436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790919202.815682:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be90f9ee00/0xc3296956897c533f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919202.815694:0:14436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88be90f9ee00/0xc3296956897c533f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919202.815706:0:14436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88be90f9ee00/0xc3296956897c533f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919202.815729:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:78fab146-b05d-43bc-9885-013f4b87a754:14436:1877914550362880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790919202.815797:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919202.815848:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beba0d9900 going to sleep for 11 seconds 00000100:00100000:1.0:1790919202.815872:0:14434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550362880 00000100:00100000:1.0:1790919202.815880:0:14434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550362880 00000100:00100000:1.0:1790919202.815950:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790919202.815960:0:14434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+11:14436:x1877914550362880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790919202.815973:0:14434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919202.815986:0:14434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88beb3f7ee00/0xc3296956897c5346 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c533f expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919202.816035:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88beb3f7ee00/0xc3296956897c5346 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c533f expref: 12 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919202.816046:0:14434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88beb3f7ee00/0xc3296956897c5346 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c533f expref: 12 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919202.816054:0:14434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88beb3f7ee00, rc 0) 00000100:00100000:1.0:1790919202.816100:0:14434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+12:14436:x1877914550362880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919202.816106:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790919202.816228:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:78fab146-b05d-43bc-9885-013f4b87a754:14436:1877914550362880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790919202.816244:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88be90f9ee00/0xc3296956897c533f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c5346 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919202.816252:0:14436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88be90f9ee00/0xc3296956897c533f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c5346 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919202.816301:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:78fab146-b05d-43bc-9885-013f4b87a754:14436:1877914550363008:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1790919202.816336:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919202.816366:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beba0d9900 going to sleep for 11 seconds 00000100:00100000:1.0:1790919202.817752:0:14433:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550363008 00000100:00100000:1.0:1790919202.817762:0:14433:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550363008 00000100:00100000:1.0:1790919202.817813:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790919202.817821:0:14433:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+12:14436:x1877914550363008:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1790919202.817841:0:14433:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790919202.817859:0:14433:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790919202.817862:0:14433:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1790919202.817981:0:14433:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+12:14436:x1877914550363008:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 161us (1644us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919202.817989:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790919202.818187:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:78fab146-b05d-43bc-9885-013f4b87a754:14436:1877914550363008:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1790919202.818238:0:14436:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790919202.818246:0:14436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be90f9ee00/0xc3296956897c533f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c5346 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919202.818256:0:14436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88be90f9ee00/0xc3296956897c533f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c5346 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790919202.948163:0:14472:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790919203.711659:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790919203.968194:0:14472:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790919204.753390:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919205.761658:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790919206.170562:0:14722:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg127-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1790919206.783775:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790919207.168955:0:13988:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790919207.168962:0:13988:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790919207.168965:0:13988:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790919207.168968:0:13988:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790919207.168971:0:13988:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1790919207.168974:0:13988:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790919207.168978:0:13988:0:(import.c:65:import_set_state_nolock()) ffff88be87132800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790919207.168996:0:13988:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff88be87132800 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:2.0:1790919207.169018:0:13988:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88bebf74d180 x1877914550363264/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790919207.169077:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:78fab146-b05d-43bc-9885-013f4b87a754:3307:1877914550363136:0@lo:400:kworker.0 00000100:00100000:2.0:1790919207.169139:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919207.169212:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877914550363264:0@lo:38:kworker.0 00000100:00100000:2.0:1790919207.169246:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919207.169279:0:14434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550363136 00000100:00100000:2.0:1790919207.169286:0:14434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550363136 00000100:00100000:2.0:1790919207.169325:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790919207.169334:0:14434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+12:3307:x1877914550363136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919207.169382:0:14434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+12:3307:x1877914550363136:12345-0@lo:400:kworker.0 Request processed in 49us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919207.169396:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790919207.169440:0:14441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550363264 00000100:00100000:2.0:1790919207.169444:0:14441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550363264 00000100:00100000:2.0:1790919207.169460:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790919207.169465:0:14441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1877914550363264:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1790919207.169487:0:14441:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 409 last 0 00000020:00000080:2.0:1790919207.169519:0:14441:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc3296956897c534d 00000004:00100000:2.0:1790919207.169557:0:14441:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790919207.169760:0:14441:0:(import.c:65:import_set_state_nolock()) ffff88bebf876000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790919207.169803:0:14441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877914550363264:12345-0@lo:38:kworker.0 Request processed in 336us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919207.169810:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790919207.169875:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff88bebf74d180 x1877914550363264/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790919217 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790919207.169890:0:3304:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1790919207.169898:0:3304:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1790919207.169902:0:3304:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790919207.169904:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88be87132800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790919207.169910:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877914550363264:0@lo:38:kworker.0 00000100:00100000:2.0:1790919207.169936:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:78fab146-b05d-43bc-9885-013f4b87a754:3307:1877914550363136:0@lo:400:kworker.0 00010000:00010000:0.0:1790919207.812934:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919208.831823:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790919209.655722:0:14873:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd772b6ce0 20000000:00000080:2.0:1790919209.655740:0:14873:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff88beb5c5f800 uarg=0000000000000000 20000000:01000000:2.0:1790919209.655790:0:14873:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1790919209.655798:0:14873:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1790919209.655802:0:14873:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1790919209.657296:0:14874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1790919209.657465:0:14873:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1790919209.670897:0:14873:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1790919209.670931:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88be90f9e200/0xc3296956897c5354 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919209.670950:0:14873:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88be813a2400/0xc3296956897c5315 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c530e expref: 11 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919209.670959:0:14873:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88be90f9e200/0xc3296956897c5354 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919209.671004:0:14873:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88be813a2400/0xc3296956897c5315 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3296956897c530e expref: 11 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919209.671031:0:14873:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88be813a2400/0xc3296956897c5315 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3296956897c530e expref: 11 pid: 14434 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919209.671048:0:14873:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14873:1877914550363392:0@lo:104: 00000100:00100000:2.0:1790919209.671113:0:14873:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919209.671207:0:14873:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be88d42240 going to sleep for 11 seconds 00000100:00100000:0.0:1790919209.678486:0:14424:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550363392 00000100:00100000:0.0:1790919209.678502:0:14424:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550363392 00000100:00100000:0.0:1790919209.679239:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790919209.679253:0:14424:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:78fab146-b05d-43bc-9885-013f4b87a754+3:14873:x1877914550363392:12345-0@lo:104: 00010000:00010000:0.0:1790919209.679274:0:14424:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.127@tcp lock: ffff88bebac59400/0xc3296956897c530e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c5315 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919209.679377:0:14424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790919209.679384:0:14424:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:78fab146-b05d-43bc-9885-013f4b87a754+3:14873:x1877914550363392:12345-0@lo:104: Request processed in 135us (8271us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919209.679392:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1790919209.679451:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919209.679458:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff88bebac59400/0xc3296956897c530e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c5315 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919209.679465:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac59400 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:1.0:1790919209.679470:0:14429:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff88bebac59400/0xc3296956897c530e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3296956897c5315 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919209.679495:0:14429:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff88bebac59400/0xc3296956897c530e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3296956897c5315 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790919209.679502:0:14429:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff88bebac59400/0xc3296956897c530e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3296956897c5315 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919209.679508:0:14429:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790919209.679581:0:14429:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff88bebac59400/0xc3296956897c530e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c5315 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919209.679588:0:14429:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790919209.679622:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff88bebac59400/0xc3296956897c530e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c5315 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919209.679629:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff88bebac59400/0xc3296956897c530e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c5315 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919209.679649:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919209.679650:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919209.679652:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919209.679673:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:78fab146-b05d-43bc-9885-013f4b87a754:3308:1877914550363520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790919209.679713:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919209.679777:0:14425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550363520 00000100:00100000:1.0:1790919209.679784:0:14425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550363520 00010000:00010000:1.0:1790919209.679805:0:14425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88be813a2400/0xc3296956897c5315 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c530e expref: 12 pid: 14434 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919209.679828:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790919209.679834:0:14425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78fab146-b05d-43bc-9885-013f4b87a754+12:3308:x1877914550363520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790919209.679852:0:14425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919209.679857:0:14425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88be813a2400/0xc3296956897c5315 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c530e expref: 12 pid: 14434 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919209.679868:0:14425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88be813a2400/0xc3296956897c5315 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3296956897c530e expref: 12 pid: 14434 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919209.679885:0:14425:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88be90f9e200/0xc3296956897c5354 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919209.679894:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be90f9e200/0xc3296956897c5354 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919209.679909:0:14425:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88be90f9e200/0xc3296956897c5354 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919209.679916:0:14425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88be90f9e200/0xc3296956897c5354 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919209.679923:0:14425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88be90f9e200/0xc3296956897c5354 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919209.679929:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88be90f9e200/0xc3296956897c5354 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919209.679935:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be90f9e200 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:1.0:1790919209.679939:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88be90f9e200/0xc3296956897c5354 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919209.679946:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88be90f9e200/0xc3296956897c5354 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919209.679966:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88be90f9e200/0xc3296956897c5354 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919209.679975:0:14425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919209.680005:0:14425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78fab146-b05d-43bc-9885-013f4b87a754+12:3308:x1877914550363520:12345-0@lo:103:ldlm_bl.0 Request processed in 171us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919209.680012:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790919209.680058:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:78fab146-b05d-43bc-9885-013f4b87a754:3308:1877914550363520:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790919209.680837:0:14873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be813a2400/0xc3296956897c5315 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3296956897c530e expref: 11 pid: 14434 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919209.680854:0:14873:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14873:1877914550363392:0@lo:104: 00010000:00010000:2.0:1790919209.680872:0:14873:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88be90f9e200/0xc3296956897c5354 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919209.680882:0:14873:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88be90f9e200/0xc3296956897c5354 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919209.680888:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88be90f9e200/0xc3296956897c5354 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919209.680905:0:14873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be90f9e200/0xc3296956897c5354 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919209.859186:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919210.884329:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919211.263686:0:3304:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790919201/real 1790919201] req@ffff88bebf78b480 x1877914550360576/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790919211 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919211.263720:0:3304:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff88bebf78b480 x1877914550360576/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790919211 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919211.263730:0:3304:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790919201/real 1790919201] req@ffff88bebf78a680 x1877914550360448/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790919211 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919211.263771:0:3304:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff88bebf78a680 x1877914550360448/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790919211 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790919211.263788:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88be92816000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790919211.263817:0:3304:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790919211.263821:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf78b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1877914550360576:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1790919211.263827:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88be9280c000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790919211.263833:0:3304:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790919211.263836:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf78a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1877914550360448:0@lo:8:llog_process_th.0 10000000:01000000:1.0:1790919211.263854:0:14436:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790919211.263859:0:14436:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88beb3f1f800 from 10 10000000:01000000:1.0:1790919211.263862:0:14436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790919211.263907:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88beb3f7e200/0xc3296956897c535b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919211.263917:0:14436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88beb3f7e200/0xc3296956897c535b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919211.263928:0:14436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88beb3f7e200/0xc3296956897c535b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919211.263948:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:78fab146-b05d-43bc-9885-013f4b87a754:14436:1877914550363648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790919211.264024:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790919211.264054:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790919211.264071:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1790919211.264074:0:8:0:(import.c:65:import_set_state_nolock()) ffff88be9280c000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1790919211.264076:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be81254cc0 going to sleep for 11 seconds 00000100:00080000:3.0:1790919211.264078:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 403 00000100:00080000:3.0:1790919211.264083:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1790919211.264091:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff88be9280c000 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:3.0:1790919211.264111:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88bebf789c00 x1877914550363904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790919211.264134:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790919211.264137:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790919211.264139:0:8:0:(import.c:65:import_set_state_nolock()) ffff88be92816000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790919211.264142:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 403 00000100:00080000:3.0:1790919211.264145:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1790919211.264150:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88be92816000 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:3.0:1790919211.264161:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88bebf789500 x1877914550364032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790919211.264268:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf789880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877914550364160:0@lo:400:kworker.0 00000100:00100000:0.0:1790919211.264306:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919211.264336:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790919211.264342:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf788700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:78fab146-b05d-43bc-9885-013f4b87a754:3306:1877914550363776:0@lo:400:kworker.0 00000100:00100000:0.0:1790919211.264377:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919211.264625:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf789c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1877914550363904:0@lo:8:kworker.0 00000400:00000100:1.0:1790919211.264647:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877914550363904 offset 0 length 520: 4 00000100:00100000:1.0:1790919211.264666:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf789500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1877914550364032:0@lo:8:kworker.0 00000400:00000100:1.0:1790919211.264692:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877914550364032 offset 0 length 520: 4 00000100:00100000:3.0:1790919211.265164:0:14440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550364160 00000100:00100000:3.0:1790919211.265173:0:14440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550364160 00000100:00100000:3.0:1790919211.265614:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790919211.265625:0:14440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877914550364160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919211.265688:0:14440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877914550364160:12345-0@lo:400:kworker.0 Request processed in 65us (1381us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919211.265696:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790919211.265764:0:14433:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550363648 00000100:00100000:2.0:1790919211.265769:0:14433:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550363648 00000100:00100000:2.0:1790919211.265795:0:14433:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550363776 00000100:00100000:2.0:1790919211.265797:0:14433:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550363776 00000100:00100000:2.0:1790919211.265807:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790919211.265824:0:14433:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+12:14436:x1877914550363648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790919211.265843:0:14433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919211.265868:0:14433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be90f9f800/0xc3296956897c5362 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c535b expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919211.265891:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be90f9f800/0xc3296956897c5362 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c535b expref: 13 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919211.265900:0:14433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be90f9f800/0xc3296956897c5362 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c535b expref: 13 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919211.265908:0:14433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be90f9f800, rc 0) 00000100:00100000:2.0:1790919211.265942:0:14433:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+13:14436:x1877914550363648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (1918us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919211.265948:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790919211.265969:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790919211.265975:0:14433:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+12:3306:x1877914550363776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919211.266011:0:14433:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+12:3306:x1877914550363776:12345-0@lo:400:kworker.0 Request processed in 36us (1633us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919211.266017:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790919211.266063:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:78fab146-b05d-43bc-9885-013f4b87a754:14436:1877914550363648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790919211.266078:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88beb3f7e200/0xc3296956897c535b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c5362 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919211.266087:0:14436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88beb3f7e200/0xc3296956897c535b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c5362 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919211.266150:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:78fab146-b05d-43bc-9885-013f4b87a754:14436:1877914550364288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790919211.266187:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919211.266223:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be8e285c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790919211.266241:0:14433:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550364288 00000100:00100000:1.0:1790919211.267326:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf788700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:78fab146-b05d-43bc-9885-013f4b87a754:3306:1877914550363776:0@lo:400:kworker.0 00010000:00080000:1.0:1790919211.267363:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff88bebf789880 x1877914550364160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919211.267376:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf789880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877914550364160:0@lo:400:kworker.0 00000100:00100000:2.0:1790919211.268407:0:14433:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550364288 00000100:00100000:2.0:1790919211.268471:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790919211.268481:0:14433:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+12:14436:x1877914550364288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790919211.268929:0:14433:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+12:14436:x1877914550364288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 449us (2740us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919211.268937:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790919211.269340:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:78fab146-b05d-43bc-9885-013f4b87a754:14436:1877914550364288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790919211.269461:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:78fab146-b05d-43bc-9885-013f4b87a754:14436:1877914550364416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790919211.270145:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919211.270180:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be8e285c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790919211.270685:0:14432:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550364416 00000100:00100000:1.0:1790919211.270694:0:14432:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550364416 00000100:00100000:1.0:1790919211.270738:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790919211.270757:0:14432:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78fab146-b05d-43bc-9885-013f4b87a754+12:14436:x1877914550364416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790919211.270942:0:14432:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78fab146-b05d-43bc-9885-013f4b87a754+12:14436:x1877914550364416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 186us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919211.270948:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790919211.271481:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:78fab146-b05d-43bc-9885-013f4b87a754:14436:1877914550364416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790919211.274507:0:14934:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1790919211.274932:0:14436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1790919211.274958:0:14436:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790919211.274970:0:14436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88beb3f7e200/0xc3296956897c535b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c5362 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919211.275000:0:14436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88beb3f7e200/0xc3296956897c535b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c5362 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919211.903997:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919212.933884:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790919213.184197:0:14472:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790919213.957876:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919214.988487:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790919215.938369:0:15121:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790919215.938373:0:15121:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1790919215.939076:0:15121:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff88bebf7d4800 00000020:01000004:0.0:1790919215.939094:0:15121:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1790919215.939106:0:15121:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1790919215.939121:0:15121:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff88bebad43380) 00000020:00000080:0.0:1790919215.939140:0:15121:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1790919215.989512:0:15121:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1790919215.994988:0:15121:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1790919215.995767:0:15121:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1790919215.996002:0:15121:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1790919215.996205:0:15121:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1790919215.996583:0:15121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 537: rc = 0 00100000:10000000:1.0:1790919215.996693:0:15121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 537: rc = 0 00100000:10000000:1.0:1790919215.996840:0:15121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 537: rc = 0 00100000:10000000:1.0:1790919215.997322:0:15121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 270: rc = 0 00100000:10000000:1.0:1790919215.997612:0:15121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 270: rc = 0 00010000:00010000:2.0:1790919216.003673:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1790919216.004174:0:15121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 270: rc = 0 00100000:10000000:1.0:1790919216.007026:0:15121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 270: rc = 0 00100000:10000000:1.0:1790919216.007329:0:15121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 270: rc = 0 00100000:10000000:0.0:1790919216.022937:0:15121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 270: rc = 0 00000020:00000080:0.0:1790919216.023586:0:15121:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1790919216.023598:0:15121:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1790919216.023609:0:15121:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc3296956897c5370 00000020:01000004:0.0:1790919216.023616:0:15121:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1790919216.023636:0:15121:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.127@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1790919216.023640:0:15121:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.127@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1790919216.023647:0:15121:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1790919216.023651:0:15121:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1790919216.023671:0:15121:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff88bebad44d40) 00000020:00000080:0.0:1790919216.023682:0:15121:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1790919216.024816:0:15121:0:(service.c:173:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790919216.024983:0:15121:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1790919216.024989:0:15121:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1790919216.036018:0:15121:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1790919216.036031:0:15121:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1790919216.040241:0:15121:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1790919216.040255:0:15121:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1790919216.049274:0:15121:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790919216.049947:0:15121:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1790919216.049955:0:15121:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1790919216.053967:0:15121:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1790919216.053983:0:15121:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1790919216.088593:0:15121:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790919216.088835:0:15121:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1790919216.088841:0:15121:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1790919216.096971:0:15121:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1790919216.096989:0:15121:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1790919216.099360:0:15121:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1790919216.099375:0:15121:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1790919216.120292:0:15121:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790919216.120497:0:15121:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1790919216.120504:0:15121:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1790919216.121408:0:15121:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1790919216.121418:0:15121:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1790919216.192796:0:15121:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790919216.193035:0:15121:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1790919216.193043:0:15121:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1790919216.196183:0:15121:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1790919216.196197:0:15121:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1790919216.197578:0:15121:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1790919216.197606:0:15121:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1790919216.197613:0:15121:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.127@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1790919216.215171:0:15121:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.127@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790919216.215211:0:15121:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.127@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1790919216.215220:0:15121:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790919216.215221:0:15121:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790919216.215222:0:15121:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790919216.215223:0:15121:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790919216.215224:0:15121:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790919216.215225:0:15121:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790919216.215226:0:15121:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790919216.215229:0:15121:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790919216.215230:0:15121:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790919216.215234:0:15121:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1790919216.215236:0:15121:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790919216.215237:0:15121:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790919216.215238:0:15121:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790919216.215239:0:15121:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790919216.215240:0:15121:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790919216.215240:0:15121:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790919216.215241:0:15121:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790919216.215242:0:15121:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790919216.215243:0:15121:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790919216.216479:0:15121:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1790919216.216508:0:15121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf789f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15121:1877914550364544:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790919216.217285:0:15121:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919216.217430:0:15121:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bebfbc9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790919216.226419:0:14434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550364544 00000100:00100000:1.0:1790919216.226437:0:14434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550364544 00000100:00100000:1.0:1790919216.226502:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790919216.226512:0:14434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+12:15121:x1877914550364544:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790919216.226922:0:14434:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1790919216.226927:0:14434:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1790919216.226931:0:14434:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1790919216.246093:0:14434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+12:15121:x1877914550364544:12345-0@lo:253:mount.lustre.0 Request processed in 19573us (28801us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919216.246120:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790919216.246235:0:15121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf789f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15121:1877914550364544:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790919216.246250:0:15121:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1790919216.246254:0:15121:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790919216.246255:0:15121:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790919216.246256:0:15121:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790919216.246258:0:15121:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790919216.246265:0:15121:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790919216.246266:0:15121:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790919216.246268:0:15121:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790919216.246270:0:15121:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790919216.246271:0:15121:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1790919216.246292:0:15121:0:(tgt_mount.c:101:server_register_mount()) register mount ffff88bebf7d4800 from lustre-OST0000 10000000:01000000:1.0:1790919216.246336:0:15121:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1790919216.246340:0:15121:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1790919216.246346:0:15121:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff88be88d30000 local copy 00010000:00010000:1.0:1790919216.246356:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be90f9ea00/0xc3296956897c5266 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c526d expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919216.246607:0:15121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b39500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15121:1877914550364672:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790919216.246643:0:15121:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919216.246688:0:15121:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be9f8a46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790919216.246902:0:14433:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550364672 00000100:00100000:2.0:1790919216.246909:0:14433:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550364672 00000100:00100000:2.0:1790919216.246954:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790919216.246963:0:14433:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+12:15121:x1877914550364672:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790919216.247124:0:14433:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+12:15121:x1877914550364672:12345-0@lo:501:mount.lustre.0 Request processed in 162us (480us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790919216.247132:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790919216.247211:0:15121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b39500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15121:1877914550364672:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1790919216.247226:0:15121:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.127@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1790919216.247380:0:15121:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.127@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1790919216.247387:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be90f9ea00/0xc3296956897c5266 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c526d expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919216.247396:0:15121:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88be90f9ea00/0xc3296956897c5266 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c526d expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919216.247426:0:15121:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff88bebf7d4800 10000000:01000000:3.0:1790919216.247436:0:15121:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790919216.247441:0:15121:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff88be88d30000 10000000:01000000:3.0:1790919216.247443:0:15121:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1790919216.247446:0:15121:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff88be88d30000 from 1 10000000:01000000:3.0:1790919216.247449:0:15121:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1790919216.247474:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be813a3a00/0xc3296956897c537e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919216.247483:0:15121:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88be813a3a00/0xc3296956897c537e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919216.247491:0:15121:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88be813a3a00/0xc3296956897c537e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919216.247504:0:15121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf78b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15121:1877914550364800:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790919216.247571:0:15121:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919216.247595:0:15121:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bebfbc9780 going to sleep for 11 seconds 00000100:00100000:2.0:1790919216.247728:0:14434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550364800 00000100:00100000:2.0:1790919216.247733:0:14434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550364800 00000100:00100000:2.0:1790919216.247770:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790919216.247778:0:14434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+12:15121:x1877914550364800:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790919216.247787:0:14434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919216.247949:0:14434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be90f9fe00/0xc3296956897c5385 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c537e expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919216.247972:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be90f9fe00/0xc3296956897c5385 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c537e expref: 13 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919216.247982:0:14434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be90f9fe00/0xc3296956897c5385 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c537e expref: 13 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919216.247991:0:14434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be90f9fe00, rc 0) 00000100:00100000:2.0:1790919216.248035:0:14434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+13:15121:x1877914550364800:12345-0@lo:101:mount.lustre.0 Request processed in 257us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919216.248041:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790919216.248136:0:15121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf78b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15121:1877914550364800:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790919216.248158:0:15121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88be813a3a00/0xc3296956897c537e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c5385 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919216.248167:0:15121:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88be813a3a00/0xc3296956897c537e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c5385 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919216.248184:0:15121:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1790919216.248200:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be813a3a00/0xc3296956897c537e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c5385 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919216.248207:0:15121:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88be813a3a00/0xc3296956897c537e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c5385 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919216.248214:0:15121:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1790919216.248218:0:15121:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790919216.248223:0:15121:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1790919216.248225:0:15121:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1790919216.248240:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88bebac59a00/0xc3296956897c538c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919216.248247:0:15121:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88bebac59a00/0xc3296956897c538c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919216.248253:0:15121:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88bebac59a00/0xc3296956897c538c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919216.248265:0:15121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15121:1877914550364928:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790919216.248292:0:15121:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919216.248305:0:15121:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beba0d9540 going to sleep for 11 seconds 00000100:00100000:2.0:1790919216.248369:0:14434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550364928 00000100:00100000:2.0:1790919216.248378:0:14434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550364928 00000100:00100000:2.0:1790919216.248397:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790919216.248468:0:14434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf69f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+13:15121:x1877914550364928:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790919216.248476:0:14434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919216.248483:0:14434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be90f9e800/0xc3296956897c5393 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c538c expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919216.248497:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be90f9e800/0xc3296956897c5393 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c538c expref: 14 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919216.248506:0:14434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be90f9e800/0xc3296956897c5393 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c538c expref: 14 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919216.248513:0:14434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be90f9e800, rc 0) 00000100:00100000:2.0:1790919216.248571:0:14434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf69f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+14:15121:x1877914550364928:12345-0@lo:101:mount.lustre.0 Request processed in 105us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919216.248577:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790919216.248715:0:15121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15121:1877914550364928:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790919216.248726:0:15121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88bebac59a00/0xc3296956897c538c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c5393 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919216.248734:0:15121:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88bebac59a00/0xc3296956897c538c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c5393 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790919216.249348:0:15121:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1790919216.250229:0:15121:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790919216.253767:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1790919216.253887:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1790919216.253927:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1790919216.253984:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1790919216.254030:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1790919216.254059:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1790919216.254138:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1790919216.254149:0:15121:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1790919216.254263:0:15121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15121:1877914550365056:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790919216.254330:0:15121:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919216.254371:0:15121:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beba0d9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790919216.254377:0:14434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550365056 00000100:00100000:2.0:1790919216.254384:0:14434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550365056 00000100:00100000:2.0:1790919216.254507:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790919216.254516:0:14434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf69ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+14:15121:x1877914550365056:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790919216.255041:0:14434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf69ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+14:15121:x1877914550365056:12345-0@lo:501:mount.lustre.0 Request processed in 525us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919216.255050:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790919216.255091:0:15121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15121:1877914550365056:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790919216.255124:0:15121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15121:1877914550365184:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790919216.255162:0:15121:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919216.255246:0:15121:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beba0d9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790919216.258026:0:14433:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550365184 00000100:00100000:3.0:1790919216.258043:0:14433:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550365184 00000100:00100000:3.0:1790919216.258112:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790919216.258122:0:14433:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf69e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+14:15121:x1877914550365184:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790919216.259282:0:14433:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf69e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+14:15121:x1877914550365184:12345-0@lo:503:mount.lustre.0 Request processed in 1145us (4103us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919216.259294:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790919216.259306:0:15121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15121:1877914550365184:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790919216.259902:0:15121:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790919216.259959:0:15121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15121:1877914550365312:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790919216.260001:0:15121:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919216.260028:0:15121:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be88024180 going to sleep for 11 seconds 00000100:00100000:2.0:1790919216.260049:0:14434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550365312 00000100:00100000:2.0:1790919216.260061:0:14434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550365312 00000100:00100000:2.0:1790919216.260106:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790919216.260115:0:14434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf69c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+14:15121:x1877914550365312:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790919216.260286:0:14434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf69c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+14:15121:x1877914550365312:12345-0@lo:502:mount.lustre.0 Request processed in 173us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919216.260292:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790919216.261513:0:15121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15121:1877914550365312:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790919216.261856:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1790919216.261912:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1790919216.261954:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1790919216.262001:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1790919216.262052:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1790919216.262085:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1790919216.262127:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1790919216.262161:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1790919216.262192:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1790919216.262238:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1790919216.262275:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1790919216.262323:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1790919216.262360:0:15121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15121:1877914550365440:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790919216.262427:0:15121:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919216.262476:0:15121:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be88024180 going to sleep for 11 seconds 00000100:00100000:2.0:1790919216.262789:0:14433:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550365440 00000100:00100000:2.0:1790919216.262797:0:14433:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550365440 00000100:00100000:2.0:1790919216.262850:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790919216.262860:0:14433:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf69d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+14:15121:x1877914550365440:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790919216.263080:0:14433:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf69d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+14:15121:x1877914550365440:12345-0@lo:502:mount.lustre.0 Request processed in 221us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919216.263088:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790919216.263246:0:15121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15121:1877914550365440:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790919216.263320:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1790919216.263330:0:15121:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1790919216.268502:0:15135:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790919216.268514:0:15135:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1790919216.268522:0:15135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919216.268543:0:15135:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1790919216.268551:0:15135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790919216.268568:0:15135:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff88bebaa319c0) 00000020:00000080:1.0:1790919216.268589:0:15135:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1790919216.268595:0:15135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790919216.268668:0:15135:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88bebf7d4800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1790919216.268675:0:15135:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790919216.268681:0:15135:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc3296956897c53a1 00010000:00010000:1.0:1790919216.272156:0:15135:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1790919216.272768:0:15135:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1790919216.274194:0:15135:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1790919216.280948:0:15135:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1790919216.280959:0:15135:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790919216.280964:0:15135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919216.280969:0:15135:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1790919216.280973:0:15135:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1790919216.280975:0:15135:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1790919216.280976:0:15135:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790919216.280977:0:15135:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790919216.280978:0:15135:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1790919216.280980:0:15135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919216.280981:0:15135:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1790919216.280982:0:15135:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790919216.280985:0:15135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919216.280986:0:15135:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790919216.280989:0:15135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790919216.280992:0:15135:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1790919216.280994:0:15135:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790919216.280996:0:15135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919216.280997:0:15135:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1790919216.280999:0:15135:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790919216.281001:0:15135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919216.281003:0:15135:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790919216.281007:0:15135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1790919216.281223:0:15135:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790919216.281227:0:15135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919216.281228:0:15135:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790919216.281231:0:15135:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1790919216.281299:0:15121:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1790919216.281326:0:15121:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1790919216.281350:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88bebac59a00/0xc3296956897c538c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c5393 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919216.281363:0:15121:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88bebac59a00/0xc3296956897c538c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c5393 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919216.281371:0:15121:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88bebf7d4800 from 1 10000000:01000000:0.0:1790919216.281373:0:15121:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790919216.281411:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88bebac58400/0xc3296956897c53a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919216.281427:0:15121:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88bebac58400/0xc3296956897c53a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919216.281441:0:15121:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88bebac58400/0xc3296956897c53a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919216.281466:0:15121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac5c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15121:1877914550365568:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790919216.281544:0:15121:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919216.281585:0:15121:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be88024240 going to sleep for 11 seconds 00000100:00100000:1.0:1790919216.281599:0:14432:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550365568 00000100:00100000:1.0:1790919216.281607:0:14432:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550365568 00000100:00100000:1.0:1790919216.281669:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790919216.281679:0:14432:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf69f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78fab146-b05d-43bc-9885-013f4b87a754+14:15121:x1877914550365568:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790919216.281694:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919216.281707:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88beb3f7ec00/0xc3296956897c53af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c53a8 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919216.281731:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88beb3f7ec00/0xc3296956897c53af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c53a8 expref: 15 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919216.281749:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88beb3f7ec00/0xc3296956897c53af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c53a8 expref: 15 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919216.281760:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88beb3f7ec00, rc 0) 00000100:00100000:1.0:1790919216.281793:0:14432:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf69f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78fab146-b05d-43bc-9885-013f4b87a754+15:15121:x1877914550365568:12345-0@lo:101:mount.lustre.0 Request processed in 117us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919216.281798:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790919216.281834:0:15121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac5c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15121:1877914550365568:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790919216.281844:0:15121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88bebac58400/0xc3296956897c53a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c53af expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919216.281850:0:15121:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88bebac58400/0xc3296956897c53a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c53af expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790919216.282328:0:15121:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1790919216.282648:0:15121:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790919216.282896:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1790919216.283617:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1790919216.283702:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1790919216.283711:0:15121:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1790919216.283782:0:15121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b39880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15121:1877914550365696:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790919216.283826:0:15121:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919216.283867:0:15121:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be9f8a4180 going to sleep for 11 seconds 00000100:00100000:0.0:1790919216.283880:0:14434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550365696 00000100:00100000:0.0:1790919216.283886:0:14434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550365696 00000100:00100000:0.0:1790919216.283930:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790919216.283938:0:14434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf69d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+15:15121:x1877914550365696:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790919216.284269:0:14434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf69d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+15:15121:x1877914550365696:12345-0@lo:501:mount.lustre.0 Request processed in 330us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919216.284278:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790919216.284356:0:15121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b39880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15121:1877914550365696:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790919216.284380:0:15121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b39880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15121:1877914550365824:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790919216.284465:0:15121:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919216.284490:0:15121:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be9f8a4180 going to sleep for 11 seconds 00000100:00100000:0.0:1790919216.284511:0:14432:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550365824 00000100:00100000:0.0:1790919216.284515:0:14432:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550365824 00000100:00100000:0.0:1790919216.284558:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790919216.284566:0:14432:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf69e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78fab146-b05d-43bc-9885-013f4b87a754+15:15121:x1877914550365824:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790919216.284726:0:14432:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf69e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78fab146-b05d-43bc-9885-013f4b87a754+15:15121:x1877914550365824:12345-0@lo:503:mount.lustre.0 Request processed in 160us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919216.284733:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790919216.284769:0:15121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b39880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15121:1877914550365824:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790919216.285128:0:15121:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790919216.285180:0:15121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b39880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15121:1877914550365952:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790919216.285208:0:15121:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919216.285356:0:14434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550365952 00000100:00100000:0.0:1790919216.285361:0:14434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550365952 00000100:00100000:1.0:1790919216.285369:0:15121:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be9f8a4180 going to sleep for 11 seconds 00000100:00100000:0.0:1790919216.285396:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790919216.285410:0:14434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf69cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+15:15121:x1877914550365952:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790919216.285572:0:14434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf69cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+15:15121:x1877914550365952:12345-0@lo:502:mount.lustre.0 Request processed in 163us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919216.285579:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790919216.285671:0:15121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b39880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15121:1877914550365952:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790919216.285879:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1790919216.285927:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1790919216.285969:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1790919216.286020:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1790919216.286055:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1790919216.286099:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1790919216.286158:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1790919216.286194:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1790919216.286214:0:15121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b39880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15121:1877914550366080:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790919216.286248:0:15121:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919216.286542:0:14432:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550366080 00000100:00100000:0.0:1790919216.286547:0:14432:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550366080 00000100:00100000:1.0:1790919216.286550:0:15121:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be9f8a4180 going to sleep for 11 seconds 00000100:00100000:0.0:1790919216.286582:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790919216.286590:0:14432:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf69d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78fab146-b05d-43bc-9885-013f4b87a754+15:15121:x1877914550366080:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790919216.286764:0:14432:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf69d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78fab146-b05d-43bc-9885-013f4b87a754+15:15121:x1877914550366080:12345-0@lo:502:mount.lustre.0 Request processed in 174us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919216.286771:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790919216.286774:0:15121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b39880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15121:1877914550366080:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790919216.286861:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1790919216.286872:0:15121:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1790919216.290588:0:15139:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790919216.290600:0:15139:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919216.290602:0:15139:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790919216.290608:0:15139:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88bebf7d4800 00000020:00000080:1.0:1790919216.290611:0:15139:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790919216.290618:0:15139:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790919216.290620:0:15139:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919216.290632:0:15139:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1790919216.290635:0:15139:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790919216.290638:0:15139:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919216.290640:0:15139:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790919216.290643:0:15139:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88bebf7d4800 00000020:00000080:1.0:1790919216.290645:0:15139:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790919216.290706:0:15139:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790919216.290709:0:15139:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919216.290711:0:15139:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1790919216.290714:0:15139:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790919216.290716:0:15139:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919216.290718:0:15139:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790919216.290721:0:15139:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff88bebf7d4800 00000020:00000080:1.0:1790919216.290723:0:15139:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790919216.290756:0:15139:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790919216.290760:0:15139:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919216.290761:0:15139:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1790919216.290926:0:15139:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1790919216.291132:0:15121:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1790919216.291154:0:15121:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790919216.291207:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88bebac58400/0xc3296956897c53a8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c53af expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919216.291221:0:15121:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88bebac58400/0xc3296956897c53a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c53af expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919216.291269:0:15121:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1790919216.291271:0:15121:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff88bebf7d4800 10000000:01000000:2.0:1790919216.291275:0:15121:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff88bebf7d4800 10000000:01000000:2.0:1790919216.291280:0:15121:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790919216.291285:0:15121:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88bebf7d4800 from 1 10000000:01000000:2.0:1790919216.291288:0:15121:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790919216.291326:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be90f9f000/0xc3296956897c53b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919216.291344:0:15121:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88be90f9f000/0xc3296956897c53b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919216.291356:0:15121:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88be90f9f000/0xc3296956897c53b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919216.291380:0:15121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15121:1877914550366208:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790919216.291455:0:15121:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919216.291503:0:15121:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be83311c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790919216.291604:0:14434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550366208 00000100:00100000:1.0:1790919216.291611:0:14434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550366208 00000100:00100000:1.0:1790919216.291663:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790919216.291673:0:14434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf69c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+15:15121:x1877914550366208:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790919216.291688:0:14434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919216.291701:0:14434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88beb3f7e800/0xc3296956897c53bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c53b6 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919216.291725:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88beb3f7e800/0xc3296956897c53bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c53b6 expref: 16 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919216.291736:0:14434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88beb3f7e800/0xc3296956897c53bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c53b6 expref: 16 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919216.291755:0:14434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88beb3f7e800, rc 0) 00000100:00100000:1.0:1790919216.291810:0:14434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf69c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+16:15121:x1877914550366208:12345-0@lo:101:mount.lustre.0 Request processed in 138us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919216.291817:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790919216.291961:0:15121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15121:1877914550366208:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790919216.291975:0:15121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88be90f9f000/0xc3296956897c53b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c53bd expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919216.291984:0:15121:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88be90f9f000/0xc3296956897c53b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c53bd expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790919216.298945:0:15121:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1790919216.299606:0:15121:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790919216.299891:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1790919216.299940:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1790919216.299975:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1790919216.300024:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1790919216.300061:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1790919216.300111:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1790919216.300145:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1790919216.300182:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1790919216.300246:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1790919216.300288:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1790919216.300345:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1790919216.300395:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1790919216.300432:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1790919216.300464:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1790919216.300510:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1790919216.300571:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1790919216.300604:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1790919216.300650:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1790919216.300700:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1790919216.300732:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1790919216.300778:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1790919216.300818:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1790919216.300852:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1790919216.300921:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1790919216.300959:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1790919216.300993:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1790919216.301072:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1790919216.301110:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1790919216.301178:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1790919216.301186:0:15121:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1790919216.301282:0:15121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15121:1877914550366336:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790919216.301350:0:15121:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919216.307438:0:15121:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be83311c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790919216.307979:0:14432:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550366336 00000100:00100000:2.0:1790919216.307988:0:14432:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550366336 00000100:00100000:2.0:1790919216.308831:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790919216.308849:0:14432:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf69fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78fab146-b05d-43bc-9885-013f4b87a754+16:15121:x1877914550366336:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790919216.309178:0:14432:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf69fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78fab146-b05d-43bc-9885-013f4b87a754+16:15121:x1877914550366336:12345-0@lo:501:mount.lustre.0 Request processed in 334us (7826us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919216.309187:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790919216.310499:0:15121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15121:1877914550366336:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790919216.310688:0:15121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15121:1877914550366464:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790919216.310752:0:15121:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919216.310837:0:14433:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550366464 00000100:00100000:3.0:1790919216.310844:0:14433:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550366464 00000100:00100000:2.0:1790919216.310858:0:15121:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be83311c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790919216.310878:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790919216.310885:0:14433:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf69f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+16:15121:x1877914550366464:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790919216.311515:0:14433:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf69f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+16:15121:x1877914550366464:12345-0@lo:503:mount.lustre.0 Request processed in 626us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919216.311559:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790919216.311772:0:15121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15121:1877914550366464:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790919216.313457:0:15121:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790919216.313617:0:15121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15121:1877914550366592:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790919216.313862:0:15121:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919216.313938:0:15121:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be83311c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790919216.313986:0:14432:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550366592 00000100:00100000:0.0:1790919216.314056:0:14432:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550366592 00000100:00100000:0.0:1790919216.314133:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790919216.314143:0:14432:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf69e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78fab146-b05d-43bc-9885-013f4b87a754+16:15121:x1877914550366592:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790919216.314365:0:14432:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf69e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78fab146-b05d-43bc-9885-013f4b87a754+16:15121:x1877914550366592:12345-0@lo:502:mount.lustre.0 Request processed in 224us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919216.314372:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790919216.314446:0:15121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15121:1877914550366592:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790919216.314696:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1790919216.314756:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1790919216.314789:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1790919216.314843:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1790919216.314909:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1790919216.314957:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1790919216.315126:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1790919216.315179:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1790919216.315232:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1790919216.315272:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1790919216.315313:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1790919216.315351:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1790919216.315384:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1790919216.315403:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1790919216.315455:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1790919216.315486:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1790919216.315503:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1790919216.315596:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1790919216.315787:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1790919216.315814:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1790919216.315842:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1790919216.315860:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1790919216.315879:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1790919216.315903:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1790919216.315921:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1790919216.315936:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1790919216.315965:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1790919216.315984:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1790919216.316044:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1790919216.316091:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1790919216.316125:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1790919216.316160:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1790919216.316195:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1790919216.316505:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1790919216.316761:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1790919216.316801:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1790919216.316819:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1790919216.316835:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1790919216.316874:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1790919216.316893:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1790919216.316933:0:15121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15121:1877914550366720:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790919216.316996:0:15121:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919216.317083:0:14433:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550366720 00000100:00100000:2.0:1790919216.317089:0:15121:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be83311540 going to sleep for 11 seconds 00000100:00100000:3.0:1790919216.317090:0:14433:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550366720 00000100:00100000:3.0:1790919216.317134:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790919216.317144:0:14433:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf69dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+16:15121:x1877914550366720:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790919216.317344:0:14433:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf69dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+16:15121:x1877914550366720:12345-0@lo:502:mount.lustre.0 Request processed in 200us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919216.317353:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790919216.317379:0:15121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15121:1877914550366720:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790919216.317495:0:15121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1790919216.317502:0:15121:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1790919216.318808:0:15144:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1790919216.318822:0:15144:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff88be88c719c0) 00000020:00000080:2.0:1790919216.318838:0:15144:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1790919216.318903:0:15144:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88bebf7d4800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1790919216.318906:0:15144:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88bebf7d4800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1790919216.318908:0:15144:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88bebf7d4800 3 00010000:00080000:2.0:1790919216.318932:0:15144:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88beb35eb000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.127@tcp at head 00010000:00010000:2.0:1790919216.323484:0:15144:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1790919216.323740:0:15144:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1790919216.323779:0:15144:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790919216.323795:0:15144:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc3296956897c53cb 00000100:00080000:2.0:1790919216.323807:0:15144:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790919216.323820:0:15144:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff88beb35eb000 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:2.0:1790919216.323855:0:15144:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88bebf74fb80 x1877914550366848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790919216.323883:0:15144:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1790919216.323914:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790919216.323921:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790919216.323925:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790919216.323928:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790919216.323983:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790919216.324295:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877914550366976:0@lo:400:kworker.0 00000100:00100000:1.0:1790919216.324441:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919216.324491:0:14439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550366976 00000100:00100000:2.0:1790919216.324499:0:14439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550366976 00000100:00100000:2.0:1790919216.324565:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790919216.324577:0:14439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877914550366976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919216.324662:0:14439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877914550366976:12345-0@lo:400:kworker.0 Request processed in 77us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919216.324671:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790919216.324681:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff88beb3b39880 x1877914550366976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919216.324696:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877914550366976:0@lo:400:kworker.0 00000100:00100000:0.0:1790919216.325784:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1877914550366848:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790919216.325829:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919216.326455:0:14440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550366848 00000100:00100000:2.0:1790919216.326464:0:14440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550366848 00000100:00100000:2.0:1790919216.326502:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790919216.326509:0:14440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3304:x1877914550366848:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1790919216.326573:0:14440:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 418 last 0 00000020:00000080:2.0:1790919216.326614:0:14440:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc3296956897c53d2 00000004:00100000:2.0:1790919216.326628:0:14440:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790919216.326673:0:14440:0:(import.c:65:import_set_state_nolock()) ffff88beb35ee000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790919216.326728:0:14440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877914550366848:12345-0@lo:38:llog_process_th.0 Request processed in 218us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919216.326735:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1790919216.326778:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff88bebf74fb80 x1877914550366848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790919226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919216.326788:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790919216.326795:0:3304:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1790919216.326801:0:3304:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1790919216.326805:0:3304:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790919216.326807:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88beb35eb000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790919216.326812:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1877914550366848:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1790919216.327359:0:15144:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1790919216.327501:0:15121:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1790919216.327558:0:15121:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790919216.327580:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be90f9f000/0xc3296956897c53b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c53bd expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919216.327591:0:15121:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88be90f9f000/0xc3296956897c53b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c53bd expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1790919216.327630:0:15121:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1790919216.327632:0:15121:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790919216.327634:0:15121:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790919216.327635:0:15121:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790919216.327636:0:15121:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790919216.327637:0:15121:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790919216.327639:0:15121:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790919216.327641:0:15121:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790919216.327642:0:15121:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790919216.327646:0:15121:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1790919216.327648:0:15121:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790919216.327650:0:15121:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790919216.327651:0:15121:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790919216.327816:0:15121:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790919216.327818:0:15121:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790919216.327819:0:15121:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790919216.327820:0:15121:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790919216.327822:0:15121:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790919216.327823:0:15121:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790919216.327840:0:15121:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1790919216.327855:0:15121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf78aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15121:1877914550367104:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790919216.327897:0:15121:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919216.327954:0:15121:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bebfbc9300 going to sleep for 11 seconds 00000100:00100000:0.0:1790919216.327983:0:14432:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550367104 00000100:00100000:0.0:1790919216.328458:0:14432:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550367104 00000100:00100000:0.0:1790919216.328559:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790919216.328569:0:14432:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf69c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78fab146-b05d-43bc-9885-013f4b87a754+16:15121:x1877914550367104:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790919216.328592:0:14432:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1790919216.328606:0:14432:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1790919216.364601:0:14432:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1790919216.364614:0:14432:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1790919216.364722:0:14455:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1790919216.364811:0:14455:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1790919216.364831:0:14455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88beb3f7e400/0xc3296956897c53d9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919216.364846:0:14455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88beb3f7ee00/0xc3296956897c5346 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c533f expref: 16 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919216.364852:0:14455:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88beb3f7e400/0xc3296956897c53d9 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919216.364894:0:14455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88beb3f7ee00/0xc3296956897c5346 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3296956897c533f expref: 16 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919216.364905:0:14455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88beb3f7ee00/0xc3296956897c5346 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3296956897c533f expref: 16 pid: 14434 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919216.364926:0:14455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b39880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14455:1877914550367232:0@lo:104: 00000100:00100000:1.0:1790919216.364983:0:14455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919216.365033:0:14455:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be9f8a4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790919216.365110:0:14424:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550367232 00000100:00100000:2.0:1790919216.365118:0:14424:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550367232 00000100:00100000:2.0:1790919216.365160:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790919216.365172:0:14424:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:78fab146-b05d-43bc-9885-013f4b87a754+3:14455:x1877914550367232:12345-0@lo:104: 00010000:00010000:2.0:1790919216.365182:0:14424:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.127@tcp lock: ffff88be90f9ee00/0xc3296956897c533f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c5346 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919216.365239:0:14424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790919216.365242:0:14424:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:78fab146-b05d-43bc-9885-013f4b87a754+3:14455:x1877914550367232:12345-0@lo:104: Request processed in 72us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919216.365247:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1790919216.365459:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790919216.365465:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff88be90f9ee00/0xc3296956897c533f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c5346 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919216.365478:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be90f9ee00 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:3.0:1790919216.365482:0:14429:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff88be90f9ee00/0xc3296956897c533f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3296956897c5346 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919216.365488:0:14429:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff88be90f9ee00/0xc3296956897c533f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3296956897c5346 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790919216.365492:0:14429:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff88be90f9ee00/0xc3296956897c533f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3296956897c5346 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919216.365495:0:14429:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790919216.365516:0:14429:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff88be90f9ee00/0xc3296956897c533f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c5346 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919216.365520:0:14429:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790919216.365553:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff88be90f9ee00/0xc3296956897c533f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c5346 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919216.365558:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff88be90f9ee00/0xc3296956897c533f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c5346 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919216.365570:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919216.365571:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919216.365572:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919216.365584:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf788000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:78fab146-b05d-43bc-9885-013f4b87a754:3308:1877914550367360:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790919216.365607:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919216.365638:0:14425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550367360 00000100:00100000:3.0:1790919216.365641:0:14425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550367360 00010000:00010000:3.0:1790919216.365667:0:14425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88beb3f7ee00/0xc3296956897c5346 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c533f expref: 17 pid: 14434 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919216.365695:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790919216.365701:0:14425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf78a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78fab146-b05d-43bc-9885-013f4b87a754+17:3308:x1877914550367360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790919216.365713:0:14425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919216.365718:0:14425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88beb3f7ee00/0xc3296956897c5346 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c533f expref: 17 pid: 14434 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919216.365727:0:14425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88beb3f7ee00/0xc3296956897c5346 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3296956897c533f expref: 17 pid: 14434 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919216.365739:0:14425:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88beb3f7e400/0xc3296956897c53d9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919216.365744:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88beb3f7e400/0xc3296956897c53d9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790919216.365755:0:14425:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000984063s 00010000:00010000:3.0:1790919216.365759:0:14425:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88beb3f7e400/0xc3296956897c53d9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919216.367736:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88beb3f7ee00/0xc3296956897c5346 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3296956897c533f expref: 17 pid: 14434 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919216.367757:0:14455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b39880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14455:1877914550367232:0@lo:104: 00010000:00010000:1.0:1790919216.367789:0:14455:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88beb3f7e400/0xc3296956897c53d9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919216.367799:0:14455:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff88beb3f7e400/0xc3296956897c53d9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919216.367806:0:14455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88beb3f7e400/0xc3296956897c53d9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919216.368470:0:14425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88beb3f7e400/0xc3296956897c53d9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919216.368476:0:14425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88beb3f7e400/0xc3296956897c53d9 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919216.368482:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88beb3f7e400/0xc3296956897c53d9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919216.368486:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88beb3f7e400 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:3.0:1790919216.368501:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88beb3f7e400/0xc3296956897c53d9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919216.368508:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88beb3f7e400/0xc3296956897c53d9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919216.368518:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88beb3f7e400/0xc3296956897c53d9 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919216.368544:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88beb3f7e400/0xc3296956897c53d9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919216.368557:0:14425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919216.368605:0:14425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf78a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78fab146-b05d-43bc-9885-013f4b87a754+16:3308:x1877914550367360:12345-0@lo:103:ldlm_bl.0 Request processed in 2905us (2997us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919216.368612:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790919216.369497:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf788000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:78fab146-b05d-43bc-9885-013f4b87a754:3308:1877914550367360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790919216.380780:0:14432:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf69c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78fab146-b05d-43bc-9885-013f4b87a754+15:15121:x1877914550367104:12345-0@lo:253:mount.lustre.0 Request processed in 52194us (52863us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919216.380795:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790919216.380942:0:15121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf78aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15121:1877914550367104:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790919216.380954:0:15121:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1790919216.380957:0:15121:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790919216.380958:0:15121:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790919216.380959:0:15121:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790919216.380959:0:15121:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790919216.380960:0:15121:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790919216.380961:0:15121:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790919216.380962:0:15121:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790919216.380964:0:15121:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790919216.380964:0:15121:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1790919216.380977:0:15121:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1790919216.385854:0:15121:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1790919216.386671:0:15121:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1790919216.386809:0:15121:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1790919216.387500:0:15121:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1790919216.387731:0:15121:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1790919216.390142:0:15121:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1790919216.391259:0:15121:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1790919216.469266:0:15121:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1790919216.469274:0:15121:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1790919216.469319:0:15121:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1790919216.469386:0:15121:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.127@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1790919216.469410:0:15121:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1790919216.469434:0:15121:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1790919217.030838:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790919217.989213:0:14436:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790919217.989220:0:14436:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88beb3f1f800 from 7 10000000:01000000:3.0:1790919217.989225:0:14436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790919217.989266:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be813a3c00/0xc3296956897c53e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919217.989291:0:14436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88be813a3c00/0xc3296956897c53e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919217.989303:0:14436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88be813a3c00/0xc3296956897c53e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919217.989328:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf78aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:78fab146-b05d-43bc-9885-013f4b87a754:14436:1877914550367488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790919217.989396:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919217.989440:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be838f8780 going to sleep for 11 seconds 00000100:00100000:3.0:1790919217.989464:0:14433:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550367488 00000100:00100000:3.0:1790919217.989473:0:14433:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550367488 00000100:00100000:3.0:1790919217.989658:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790919217.989667:0:14433:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+15:14436:x1877914550367488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790919217.989680:0:14433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919217.989694:0:14433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be813a2400/0xc3296956897c53e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c53e0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919217.989717:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be813a2400/0xc3296956897c53e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c53e0 expref: 16 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919217.989727:0:14433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be813a2400/0xc3296956897c53e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c53e0 expref: 16 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919217.990831:0:14433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be813a2400, rc 0) 00000100:00100000:3.0:1790919217.990915:0:14433:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+16:14436:x1877914550367488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1236us (1506us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919217.990924:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790919217.995911:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf78aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:78fab146-b05d-43bc-9885-013f4b87a754:14436:1877914550367488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790919217.995939:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88be813a3c00/0xc3296956897c53e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c53e7 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919217.995953:0:14436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88be813a3c00/0xc3296956897c53e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c53e7 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919217.996036:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac5df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:78fab146-b05d-43bc-9885-013f4b87a754:14436:1877914550367616:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1790919217.996096:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919217.996133:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be88d42f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790919217.996153:0:14432:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550367616 00000100:00100000:0.0:1790919217.996158:0:14432:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550367616 00000100:00100000:0.0:1790919217.996198:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790919217.996205:0:14432:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba116850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78fab146-b05d-43bc-9885-013f4b87a754+16:14436:x1877914550367616:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1790919217.996226:0:14432:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790919217.996240:0:14432:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790919217.996244:0:14432:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1790919217.996319:0:14432:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba116850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78fab146-b05d-43bc-9885-013f4b87a754+16:14436:x1877914550367616:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 113us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919217.996326:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790919217.996358:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac5df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:78fab146-b05d-43bc-9885-013f4b87a754:14436:1877914550367616:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1790919217.996404:0:14436:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790919217.996410:0:14436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be813a3c00/0xc3296956897c53e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c53e7 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919217.996419:0:14436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88be813a3c00/0xc3296956897c53e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c53e7 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919218.048427:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919219.079853:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919220.109865:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919221.119860:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790919221.521075:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790919221.521082:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790919221.521085:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790919221.521088:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790919221.521125:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf78b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1877914550368000:0@lo:400:kworker.0 00000100:00100000:3.0:1790919221.521197:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919221.521694:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf78aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:78fab146-b05d-43bc-9885-013f4b87a754:3305:1877914550367744:0@lo:400:kworker.0 00000100:00100000:2.0:1790919221.521731:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919221.521760:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790919221.521766:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf788000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877914550367872:0@lo:400:kworker.0 00000100:00100000:2.0:1790919221.521786:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919221.521826:0:14440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550368000 00000100:00100000:2.0:1790919221.521834:0:14440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550368000 00000100:00100000:2.0:1790919221.521886:0:14440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550367872 00000100:00100000:2.0:1790919221.521889:0:14440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550367872 00000100:00100000:2.0:1790919221.521903:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790919221.521910:0:14440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf789f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877914550368000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919221.521962:0:14440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf789f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877914550368000:12345-0@lo:400:kworker.0 Request processed in 52us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919221.521981:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790919221.522000:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790919221.522007:0:14440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877914550367872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919221.522039:0:14440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877914550367872:12345-0@lo:400:kworker.0 Request processed in 33us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919221.522045:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1790919221.522076:0:14435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790919221.522107:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88bebf78b800 x1877914550368000/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919221.522121:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf78b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1877914550368000:0@lo:400:kworker.0 00010000:00080000:2.0:1790919221.522157:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88bebf788000 x1877914550367872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919221.522167:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf788000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877914550367872:0@lo:400:kworker.0 00000100:00100000:3.0:1790919221.523982:0:14434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550367744 00000100:00100000:3.0:1790919221.523995:0:14434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550367744 00000100:00100000:3.0:1790919221.524047:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790919221.524057:0:14434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+16:3305:x1877914550367744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919221.524127:0:14434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+16:3305:x1877914550367744:12345-0@lo:400:kworker.0 Request processed in 72us (2394us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919221.524134:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790919221.526121:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf78aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:78fab146-b05d-43bc-9885-013f4b87a754:3305:1877914550367744:0@lo:400:kworker.0 00010000:00010000:3.0:1790919222.144176:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919223.167802:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790919223.424194:0:14472:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790919224.192785:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790919224.256498:0:15490:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg127-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1790919225.215815:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919226.240005:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919226.571812:0:3304:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790919211/real 1790919211] req@ffff88bebf789c00 x1877914550363904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790919226 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919226.571843:0:3304:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff88bebf789c00 x1877914550363904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790919226 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919226.571851:0:3304:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790919211/real 1790919211] req@ffff88bebf789500 x1877914550364032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790919226 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919226.571862:0:3304:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff88bebf789500 x1877914550364032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790919226 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790919226.571880:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88be9280c000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790919226.571904:0:3304:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790919226.571908:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf789c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1877914550363904:0@lo:8:kworker.0 00000100:00080000:0.0:1790919226.571915:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88be92816000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790919226.571920:0:3304:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790919226.571923:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf789500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1877914550364032:0@lo:8:kworker.0 00000100:00080000:3.0:1790919226.572024:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790919226.572029:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1790919226.572032:0:37:0:(import.c:65:import_set_state_nolock()) ffff88be9280c000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790919226.572037:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 413 00000100:00080000:3.0:1790919226.572052:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1790919226.572065:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff88be9280c000 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:3.0:1790919226.572074:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790919226.572085:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf789880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:78fab146-b05d-43bc-9885-013f4b87a754:3307:1877914550368128:0@lo:400:kworker.0 00000100:00100000:3.0:1790919226.572149:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919226.572203:0:14433:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550368128 00000100:00100000:3.0:1790919226.572218:0:14433:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550368128 00000100:00100000:3.0:1790919226.572262:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790919226.572271:0:14433:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+16:3307:x1877914550368128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919226.572320:0:14433:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+16:3307:x1877914550368128:12345-0@lo:400:kworker.0 Request processed in 50us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919226.572327:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790919226.572367:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf789880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:78fab146-b05d-43bc-9885-013f4b87a754:3307:1877914550368128:0@lo:400:kworker.0 00000100:00100000:3.0:1790919226.572400:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88bebf789880 x1877914550368256/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790919226.572415:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790919226.572418:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790919226.572420:0:37:0:(import.c:65:import_set_state_nolock()) ffff88be92816000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790919226.572423:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 413 00000100:00080000:3.0:1790919226.572425:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1790919226.572430:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88be92816000 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:3.0:1790919226.572437:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf789880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1877914550368256:0@lo:8:kworker.0 00000100:00100000:3.0:1790919226.572467:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919226.572512:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88bebf78a680 x1877914550368384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790919226.572560:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf78a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1877914550368384:0@lo:8:kworker.0 00000100:00100000:3.0:1790919226.572586:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919226.572656:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf788380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877914550368512:0@lo:400:kworker.0 00000100:00100000:3.0:1790919226.572683:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919226.572714:0:14440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550368512 00000100:00100000:3.0:1790919226.572725:0:14440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550368512 00000100:00100000:3.0:1790919226.572753:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790919226.572760:0:14440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf788e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877914550368512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919226.572798:0:14440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf788e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877914550368512:12345-0@lo:400:kworker.0 Request processed in 39us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919226.572805:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1790919226.572832:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88bebf788380 x1877914550368512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919226.572841:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf788380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877914550368512:0@lo:400:kworker.0 00000100:00100000:3.0:1790919226.572873:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf788380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1877914550368640:0@lo:400:kworker.0 00000100:00100000:3.0:1790919226.572895:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919226.572924:0:14441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550368640 00000100:00100000:3.0:1790919226.572927:0:14441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550368640 00000100:00100000:3.0:1790919226.572954:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790919226.572959:0:14441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf789180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877914550368640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919226.572990:0:14441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf789180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877914550368640:12345-0@lo:400:kworker.0 Request processed in 30us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919226.572996:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1790919226.573011:0:14435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790919226.573028:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88bebf788380 x1877914550368640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919226.573037:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf788380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1877914550368640:0@lo:400:kworker.0 00000100:00100000:0.0:1790919226.573205:0:15122:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550368256 00000100:00100000:0.0:1790919226.573210:0:15122:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550368256 00000100:00100000:0.0:1790919226.573228:0:15122:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550368384 00000100:00100000:0.0:1790919226.573231:0:15122:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550368384 00000100:00100000:0.0:1790919226.573242:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790919226.573246:0:15122:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf788700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1877914550368256:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1790919226.573279:0:15122:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 428 last 0 00000020:00000080:0.0:1790919226.573308:0:15122:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3296956897c53ee 00002000:00100000:0.0:1790919226.573321:0:15122:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff88be86b74800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1790919226.573325:0:15122:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1790919226.573328:0:15122:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1790919226.573708:0:15122:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790919226.573734:0:15122:0:(import.c:65:import_set_state_nolock()) ffff88be86b76800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790919226.573782:0:15122:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf788700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1877914550368256:12345-0@lo:8:kworker.0 Request processed in 534us (1313us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919226.573788:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790919226.573804:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790919226.573809:0:15122:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf78b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1877914550368384:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1790919226.573819:0:15122:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1790919226.573844:0:15122:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf78b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1877914550368384:12345-0@lo:8:kworker.0 Request processed in 34us (1257us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790919226.573850:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1790919226.575756:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88be92816000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790919226.575767:0:3304:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790919226.575772:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf78a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1877914550368384:0@lo:8:kworker.0 00010000:00080000:3.0:1790919226.575799:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88bebf789880 x1877914550368256/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790919246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919226.575808:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790919226.575816:0:3304:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1790919226.575825:0:3304:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1790919226.575830:0:3304:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1790919226.575833:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88be9280c000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1790919226.575859:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1790919226.575864:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf789880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1877914550368256:0@lo:8:kworker.0 00000004:00080000:1.0:1790919226.575939:0:14461:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1790919226.576326:0:14461:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 428464798180ns, next at 0ns, rc = 0 00000004:00080000:0.0:1790919226.576945:0:14462:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:0.0:1790919226.576968:0:14462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac5fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14462:1877914550368896:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1790919226.577033:0:14462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919226.577060:0:14462:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb3f48000 going to sleep for 11 seconds 00000100:00100000:0.0:1790919226.577075:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790919226.577085:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550368768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790919226.577110:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919226.577143:0:15122:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550368896 00000100:00100000:0.0:1790919226.577150:0:15122:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550368896 00000100:00100000:0.0:1790919226.577207:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790919226.577216:0:15122:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14462:x1877914550368896:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:3.0:1790919226.579849:0:14435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790919226.580140:0:15126:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550368768 00000100:00100000:1.0:1790919226.580150:0:15126:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550368768 00000100:00100000:1.0:1790919226.580199:0:15126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790919226.580207:0:15126:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1877914550368768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790919226.580241:0:15126:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919226.580327:0:15126:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1877914550368768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (3215us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919226.580334:0:15126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1790919226.582862:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88bebac5df80 x1877914550368768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919242 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919226.582894:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550368768:0@lo:13:osp-pre-0-0.0 00002000:00080000:0.0:1790919226.591125:0:15122:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1790919226.591139:0:15122:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1790919226.591145:0:15122:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:0.0:1790919226.611127:0:15122:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790919226.611139:0:15122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c53f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919226.611155:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=428s v=(0 0) 00010000:00010000:0.0:1790919226.611160:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919226.613010:0:15122:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c53f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919226.613045:0:15122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c53f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919226.613057:0:15122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c53f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919226.613065:0:15122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c53f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919226.613451:0:15122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790919226.613467:0:14428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919226.613485:0:14428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c53f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919226.613509:0:14428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac58800 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:0.0:1790919226.613514:0:14428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c53f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919226.613524:0:14428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c53f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919226.613556:0:14428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c53f5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919226.613563:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c53f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919226.613585:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919226.613587:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919226.613589:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790919226.621869:0:15122:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790919226.621881:0:15122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a95e4b/0xc3296956897c53fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919226.621897:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=428s v=(0 0) 00010000:00010000:0.0:1790919226.621902:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919226.621908:0:15122:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a95e4b/0xc3296956897c53fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919226.621921:0:15122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a95e4b/0xc3296956897c53fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919226.621938:0:15122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a95e4b/0xc3296956897c53fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919226.621946:0:15122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a95e4b/0xc3296956897c53fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919226.621973:0:15122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790919226.622661:0:15122:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790919226.622668:0:15122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003122c64b/0xc3296956897c5403 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919226.622678:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=428s v=(0 0) 00010000:00010000:0.0:1790919226.622682:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919226.622686:0:15122:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003122c64b/0xc3296956897c5403 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919226.622696:0:15122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003122c64b/0xc3296956897c5403 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.622754:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919226.622762:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a95e4b/0xc3296956897c53fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.622769:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac58a00 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:1.0:1790919226.622773:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a95e4b/0xc3296956897c53fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.622782:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a95e4b/0xc3296956897c53fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.622808:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a95e4b/0xc3296956897c53fc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.622815:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a95e4b/0xc3296956897c53fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.622832:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919226.622834:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919226.622836:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919226.628393:0:15122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003122c64b/0xc3296956897c5403 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919226.628411:0:15122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003122c64b/0xc3296956897c5403 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.630955:0:15122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790919226.632930:0:15122:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790919226.632942:0:15122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005623cc6b/0xc3296956897c540a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.632959:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=428s v=(0 0) 00010000:00010000:1.0:1790919226.632964:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919226.632971:0:15122:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005623cc6b/0xc3296956897c540a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.632985:0:15122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005623cc6b/0xc3296956897c540a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.632995:0:15122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005623cc6b/0xc3296956897c540a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.633002:0:15122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005623cc6b/0xc3296956897c540a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.633030:0:15122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1790919226.633045:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790919226.633051:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003122c64b/0xc3296956897c5403 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.633059:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac58600 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:1.0:1790919226.633064:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003122c64b/0xc3296956897c5403 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.633073:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003122c64b/0xc3296956897c5403 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.633091:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003122c64b/0xc3296956897c5403 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.633098:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003122c64b/0xc3296956897c5403 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.633117:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919226.633120:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005623cc6b/0xc3296956897c540a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.633127:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88beb3f7ee00 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:1.0:1790919226.633131:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005623cc6b/0xc3296956897c540a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.633148:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005623cc6b/0xc3296956897c540a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.633158:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005623cc6b/0xc3296956897c540a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.633165:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005623cc6b/0xc3296956897c540a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.633180:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919226.633182:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919226.633183:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790919226.633914:0:15122:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790919226.633922:0:15122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000036b1391/0xc3296956897c5411 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.633934:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=428s v=(0 0) 00010000:00010000:1.0:1790919226.633938:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919226.633942:0:15122:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000036b1391/0xc3296956897c5411 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.633952:0:15122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000036b1391/0xc3296956897c5411 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.633961:0:15122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000036b1391/0xc3296956897c5411 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.633974:0:15122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000036b1391/0xc3296956897c5411 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.633989:0:15122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790919226.633999:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919226.634004:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000036b1391/0xc3296956897c5411 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.634011:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88beb3f7e400 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:1.0:1790919226.634015:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000036b1391/0xc3296956897c5411 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.634024:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000036b1391/0xc3296956897c5411 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.634037:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000036b1391/0xc3296956897c5411 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.634044:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000036b1391/0xc3296956897c5411 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.634062:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919226.634063:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919226.634065:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790919226.634471:0:15122:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790919226.634496:0:15122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037e9b534/0xc3296956897c5418 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.634505:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=428s v=(0 0) 00010000:00010000:1.0:1790919226.634509:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919226.634513:0:15122:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037e9b534/0xc3296956897c5418 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.634522:0:15122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037e9b534/0xc3296956897c5418 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.634556:0:15122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037e9b534/0xc3296956897c5418 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.634565:0:15122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037e9b534/0xc3296956897c5418 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.634578:0:15122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790919226.634586:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919226.635428:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919226.636386:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037e9b534/0xc3296956897c5418 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.636400:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88beb3f7fc00 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:1.0:1790919226.636407:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037e9b534/0xc3296956897c5418 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.636415:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037e9b534/0xc3296956897c5418 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.636440:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037e9b534/0xc3296956897c5418 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.636447:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037e9b534/0xc3296956897c5418 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.636509:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919226.636511:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919226.636513:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790919226.637040:0:15122:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790919226.637048:0:15122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010076993/0xc3296956897c541f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.637060:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=428s v=(0 0) 00010000:00010000:1.0:1790919226.637064:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919226.637070:0:15122:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010076993/0xc3296956897c541f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.637081:0:15122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010076993/0xc3296956897c541f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.637089:0:15122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010076993/0xc3296956897c541f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.637098:0:15122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010076993/0xc3296956897c541f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.637126:0:15122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790919226.637138:0:14428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919226.637143:0:14428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010076993/0xc3296956897c541f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.637150:0:14428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88beb3f7fa00 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:1.0:1790919226.637154:0:14428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010076993/0xc3296956897c541f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.637162:0:14428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010076993/0xc3296956897c541f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.637174:0:14428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010076993/0xc3296956897c541f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.637181:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010076993/0xc3296956897c541f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.637194:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919226.637196:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919226.637197:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790919226.637634:0:15122:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790919226.637640:0:15122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c97af259/0xc3296956897c5426 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.637649:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=428s v=(0 0) 00010000:00010000:1.0:1790919226.637658:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919226.637663:0:15122:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c97af259/0xc3296956897c5426 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.637671:0:15122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c97af259/0xc3296956897c5426 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.637679:0:15122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c97af259/0xc3296956897c5426 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.637686:0:15122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c97af259/0xc3296956897c5426 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.637699:0:15122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790919226.637710:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919226.637714:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c97af259/0xc3296956897c5426 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.637721:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88beb3f7f800 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:1.0:1790919226.637725:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c97af259/0xc3296956897c5426 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.637732:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c97af259/0xc3296956897c5426 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.637744:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c97af259/0xc3296956897c5426 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.637762:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c97af259/0xc3296956897c5426 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.637775:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919226.637777:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919226.637779:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790919226.638302:0:15122:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790919226.638309:0:15122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bea24ecf/0xc3296956897c542d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.638319:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=428s v=(0 0) 00010000:00010000:1.0:1790919226.638323:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919226.638327:0:15122:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bea24ecf/0xc3296956897c542d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.638335:0:15122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bea24ecf/0xc3296956897c542d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.638344:0:15122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bea24ecf/0xc3296956897c542d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.638352:0:15122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bea24ecf/0xc3296956897c542d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.638365:0:15122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790919226.638373:0:14428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919226.638383:0:14428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bea24ecf/0xc3296956897c542d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.638390:0:14428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88beb3f7e600 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:1.0:1790919226.638393:0:14428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bea24ecf/0xc3296956897c542d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.638401:0:14428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bea24ecf/0xc3296956897c542d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.638413:0:14428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bea24ecf/0xc3296956897c542d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.638421:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bea24ecf/0xc3296956897c542d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.638436:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919226.638438:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919226.638440:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790919226.638862:0:15122:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790919226.638868:0:15122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039733a50/0xc3296956897c5434 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.638878:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=428s v=(0 0) 00010000:00010000:1.0:1790919226.638882:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919226.638886:0:15122:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039733a50/0xc3296956897c5434 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.638907:0:15122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039733a50/0xc3296956897c5434 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.638915:0:15122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039733a50/0xc3296956897c5434 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.638923:0:15122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039733a50/0xc3296956897c5434 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.638936:0:15122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790919226.638944:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919226.638949:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039733a50/0xc3296956897c5434 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.638956:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88beb3f7f600 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:1.0:1790919226.638959:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039733a50/0xc3296956897c5434 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.638968:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039733a50/0xc3296956897c5434 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.638979:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039733a50/0xc3296956897c5434 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.638987:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039733a50/0xc3296956897c5434 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.639008:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919226.639010:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919226.639012:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790919226.639381:0:15122:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790919226.639387:0:15122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068e31704/0xc3296956897c543b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.639396:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=428s v=(0 0) 00010000:00010000:1.0:1790919226.639398:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919226.639403:0:15122:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068e31704/0xc3296956897c543b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.639411:0:15122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068e31704/0xc3296956897c543b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.639419:0:15122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068e31704/0xc3296956897c543b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.639426:0:15122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068e31704/0xc3296956897c543b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.639438:0:15122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790919226.639446:0:14428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919226.639449:0:14428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068e31704/0xc3296956897c543b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.639466:0:14428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88beb3f7fe00 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:1.0:1790919226.639469:0:14428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068e31704/0xc3296956897c543b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790919226.642069:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:1.0:1790919226.644505:0:14428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068e31704/0xc3296956897c543b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.645063:0:14428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068e31704/0xc3296956897c543b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.645075:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068e31704/0xc3296956897c543b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.645313:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919226.645316:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919226.645318:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790919226.647934:0:15122:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790919226.647946:0:15122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ff7d8f2/0xc3296956897c5442 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.647963:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=428s v=(0 0) 00010000:00010000:1.0:1790919226.647968:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919226.647974:0:15122:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ff7d8f2/0xc3296956897c5442 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.647988:0:15122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ff7d8f2/0xc3296956897c5442 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.648006:0:15122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ff7d8f2/0xc3296956897c5442 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.648015:0:15122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ff7d8f2/0xc3296956897c5442 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.648044:0:15122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790919226.648370:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919226.648379:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ff7d8f2/0xc3296956897c5442 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919226.648388:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88beb3f7e000 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:2.0:1790919226.648393:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ff7d8f2/0xc3296956897c5442 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919226.648403:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ff7d8f2/0xc3296956897c5442 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919226.648427:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ff7d8f2/0xc3296956897c5442 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919226.648436:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ff7d8f2/0xc3296956897c5442 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919226.648460:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919226.648462:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919226.648464:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790919226.649881:0:15122:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790919226.649892:0:15122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c317d6d5/0xc3296956897c5449 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.649907:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=428s v=(0 0) 00010000:00010000:1.0:1790919226.649912:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919226.649918:0:15122:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c317d6d5/0xc3296956897c5449 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.649931:0:15122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c317d6d5/0xc3296956897c5449 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.649939:0:15122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c317d6d5/0xc3296956897c5449 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.649947:0:15122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c317d6d5/0xc3296956897c5449 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.650015:0:15122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790919226.650499:0:15122:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790919226.650506:0:15122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef48d928/0xc3296956897c5450 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.650517:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=428s v=(0 0) 00010000:00010000:1.0:1790919226.650521:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919226.650547:0:15122:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef48d928/0xc3296956897c5450 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.650558:0:15122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef48d928/0xc3296956897c5450 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.650566:0:15122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef48d928/0xc3296956897c5450 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.650574:0:15122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef48d928/0xc3296956897c5450 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919226.652520:0:14428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790919226.652544:0:14428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c317d6d5/0xc3296956897c5449 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919226.652557:0:14428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88beb3f7f200 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:2.0:1790919226.652562:0:14428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c317d6d5/0xc3296956897c5449 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919226.652573:0:14428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c317d6d5/0xc3296956897c5449 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919226.652603:0:14428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c317d6d5/0xc3296956897c5449 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919226.652611:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c317d6d5/0xc3296956897c5449 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919226.652872:0:14428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919226.652877:0:14428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef48d928/0xc3296956897c5450 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919226.652886:0:14428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81517a00 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:2.0:1790919226.652889:0:14428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef48d928/0xc3296956897c5450 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919226.652898:0:14428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef48d928/0xc3296956897c5450 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919226.652910:0:14428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef48d928/0xc3296956897c5450 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919226.652919:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919226.652920:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919226.652922:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919226.655906:0:15122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1790919226.655932:0:15122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef48d928/0xc3296956897c5450 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919226.658491:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790919226.659748:0:15122:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790919226.659761:0:15122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008ee7f4a/0xc3296956897c5457 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.659785:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=428s v=(0 0) 00010000:00010000:1.0:1790919226.659790:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919226.659797:0:15122:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008ee7f4a/0xc3296956897c5457 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.659812:0:15122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008ee7f4a/0xc3296956897c5457 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.659822:0:15122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008ee7f4a/0xc3296956897c5457 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.659830:0:15122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008ee7f4a/0xc3296956897c5457 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.659896:0:15122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790919226.660421:0:15122:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790919226.660428:0:15122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c0ff045/0xc3296956897c545e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.660437:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=428s v=(0 0) 00010000:00010000:1.0:1790919226.660440:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919226.660444:0:15122:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c0ff045/0xc3296956897c545e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.660547:0:15122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c0ff045/0xc3296956897c545e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.660567:0:15122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c0ff045/0xc3296956897c545e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.660575:0:15122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c0ff045/0xc3296956897c545e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919226.663420:0:14428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790919226.663434:0:14428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008ee7f4a/0xc3296956897c5457 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919226.663448:0:14428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81517200 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:3.0:1790919226.663453:0:14428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008ee7f4a/0xc3296956897c5457 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919226.663465:0:14428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008ee7f4a/0xc3296956897c5457 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919226.663501:0:14428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008ee7f4a/0xc3296956897c5457 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919226.663517:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008ee7f4a/0xc3296956897c5457 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919226.663553:0:14428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790919226.663557:0:14428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c0ff045/0xc3296956897c545e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919226.663565:0:14428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81517600 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:3.0:1790919226.663568:0:14428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c0ff045/0xc3296956897c545e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919226.663575:0:14428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c0ff045/0xc3296956897c545e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919226.663585:0:14428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c0ff045/0xc3296956897c545e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919226.663603:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919226.663605:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919226.663607:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919226.670133:0:15122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1790919226.670148:0:15122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c0ff045/0xc3296956897c545e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790919226.670820:0:15122:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790919226.670828:0:15122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9699464/0xc3296956897c5465 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.670843:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=428s v=(0 0) 00010000:00010000:1.0:1790919226.670847:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919226.670853:0:15122:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9699464/0xc3296956897c5465 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.670866:0:15122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9699464/0xc3296956897c5465 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.670876:0:15122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9699464/0xc3296956897c5465 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.670892:0:15122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9699464/0xc3296956897c5465 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.670911:0:15122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790919226.670923:0:14428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919226.670928:0:14428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9699464/0xc3296956897c5465 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.670935:0:14428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81516c00 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:1.0:1790919226.670939:0:14428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9699464/0xc3296956897c5465 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.670948:0:14428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9699464/0xc3296956897c5465 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.670964:0:14428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9699464/0xc3296956897c5465 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.670972:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9699464/0xc3296956897c5465 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.670986:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919226.670988:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919226.670990:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790919226.671401:0:15122:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790919226.671415:0:15122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0ec3631/0xc3296956897c546c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.671424:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=428s v=(0 0) 00010000:00010000:1.0:1790919226.671428:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919226.671433:0:15122:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0ec3631/0xc3296956897c546c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.671443:0:15122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0ec3631/0xc3296956897c546c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.671451:0:15122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0ec3631/0xc3296956897c546c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.671459:0:15122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0ec3631/0xc3296956897c546c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.671487:0:15122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790919226.671496:0:14428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919226.671501:0:14428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0ec3631/0xc3296956897c546c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.671507:0:14428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81517400 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:1.0:1790919226.671511:0:14428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0ec3631/0xc3296956897c546c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.671519:0:14428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0ec3631/0xc3296956897c546c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.671575:0:14428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0ec3631/0xc3296956897c546c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.671583:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0ec3631/0xc3296956897c546c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.671596:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919226.671598:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919226.671600:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790919226.671997:0:15122:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790919226.672004:0:15122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b4a09b9/0xc3296956897c5473 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.672014:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=428s v=(0 0) 00010000:00010000:1.0:1790919226.672017:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919226.672021:0:15122:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b4a09b9/0xc3296956897c5473 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.672031:0:15122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b4a09b9/0xc3296956897c5473 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.672039:0:15122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b4a09b9/0xc3296956897c5473 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.672046:0:15122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b4a09b9/0xc3296956897c5473 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.672071:0:15122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790919226.672079:0:14428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919226.672083:0:14428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b4a09b9/0xc3296956897c5473 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.672090:0:14428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81516400 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:1.0:1790919226.672093:0:14428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b4a09b9/0xc3296956897c5473 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.672101:0:14428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b4a09b9/0xc3296956897c5473 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.672112:0:14428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b4a09b9/0xc3296956897c5473 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.672119:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b4a09b9/0xc3296956897c5473 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.672132:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919226.672134:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919226.672136:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790919226.672513:0:15122:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790919226.672519:0:15122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053d7ba22/0xc3296956897c547a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.672552:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=428s v=(0 0) 00010000:00010000:1.0:1790919226.672561:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919226.672566:0:15122:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053d7ba22/0xc3296956897c547a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.672575:0:15122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053d7ba22/0xc3296956897c547a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.672583:0:15122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053d7ba22/0xc3296956897c547a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.672591:0:15122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053d7ba22/0xc3296956897c547a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.672603:0:15122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790919226.672612:0:14428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919226.672615:0:14428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053d7ba22/0xc3296956897c547a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.672621:0:14428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81516800 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:1.0:1790919226.672624:0:14428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053d7ba22/0xc3296956897c547a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.672631:0:14428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053d7ba22/0xc3296956897c547a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.672642:0:14428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053d7ba22/0xc3296956897c547a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.672659:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053d7ba22/0xc3296956897c547a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.672673:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919226.672675:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919226.672677:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790919226.673046:0:15122:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790919226.673052:0:15122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f38f766/0xc3296956897c5481 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.673062:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=428s v=(0 0) 00010000:00010000:1.0:1790919226.673065:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919226.673070:0:15122:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f38f766/0xc3296956897c5481 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.673079:0:15122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f38f766/0xc3296956897c5481 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.673087:0:15122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f38f766/0xc3296956897c5481 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.673095:0:15122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f38f766/0xc3296956897c5481 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.673108:0:15122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790919226.673115:0:14428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919226.673124:0:14428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f38f766/0xc3296956897c5481 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.673131:0:14428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81517e00 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:1.0:1790919226.673135:0:14428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f38f766/0xc3296956897c5481 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.673144:0:14428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f38f766/0xc3296956897c5481 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.673155:0:14428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f38f766/0xc3296956897c5481 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.673162:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f38f766/0xc3296956897c5481 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.673175:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919226.673177:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919226.673179:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919226.673798:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790919226.679946:0:15122:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790919226.679962:0:15122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c5488 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919226.679980:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=428s v=(0 0) 00010000:00010000:0.0:1790919226.679985:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919226.679991:0:15122:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c5488 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919226.680004:0:15122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c5488 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919226.680015:0:15122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c5488 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919226.680023:0:15122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c5488 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919226.680052:0:15122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790919226.680161:0:14428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919226.680169:0:14428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c5488 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919226.680178:0:14428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac58800 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:2.0:1790919226.680182:0:14428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c5488 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919226.680202:0:14428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c5488 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919226.680230:0:14428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c5488 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919226.680238:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c5488 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919226.680255:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919226.680257:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919226.680259:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790919226.687006:0:15122:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790919226.687021:0:15122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccaf95e3/0xc3296956897c548f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919226.687039:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=428s v=(0 0) 00010000:00010000:0.0:1790919226.687043:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919226.687055:0:15122:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ccaf95e3/0xc3296956897c548f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919226.687069:0:15122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ccaf95e3/0xc3296956897c548f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919226.687080:0:15122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccaf95e3/0xc3296956897c548f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919226.687087:0:15122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ccaf95e3/0xc3296956897c548f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919226.687116:0:15122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790919226.687194:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919226.687202:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ccaf95e3/0xc3296956897c548f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919226.687210:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac59e00 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:2.0:1790919226.687215:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccaf95e3/0xc3296956897c548f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919226.687237:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccaf95e3/0xc3296956897c548f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919226.687256:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ccaf95e3/0xc3296956897c548f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919226.687274:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ccaf95e3/0xc3296956897c548f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919226.687291:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919226.687293:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919226.687295:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790919226.694314:0:15122:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790919226.694330:0:15122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000544f7fce/0xc3296956897c5496 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919226.694347:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=428s v=(0 0) 00010000:00010000:0.0:1790919226.694352:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919226.694357:0:15122:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000544f7fce/0xc3296956897c5496 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919226.694370:0:15122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000544f7fce/0xc3296956897c5496 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919226.694380:0:15122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000544f7fce/0xc3296956897c5496 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919226.694400:0:15122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000544f7fce/0xc3296956897c5496 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919226.694425:0:15122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00100000:3.0:1790919226.694790:0:6722:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1790919226.694846:0:14428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919226.694854:0:14428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000544f7fce/0xc3296956897c5496 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919226.694862:0:14428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac58200 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:2.0:1790919226.694867:0:14428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000544f7fce/0xc3296956897c5496 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919226.694876:0:14428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000544f7fce/0xc3296956897c5496 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919226.694891:0:14428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000544f7fce/0xc3296956897c5496 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919226.694897:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000544f7fce/0xc3296956897c5496 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919226.694914:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919226.694916:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919226.694917:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790919226.695114:0:15122:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790919226.695120:0:15122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1497d4b/0xc3296956897c549d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919226.695129:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=428s v=(0 0) 00010000:00010000:0.0:1790919226.695133:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919226.695137:0:15122:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1497d4b/0xc3296956897c549d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919226.695146:0:15122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1497d4b/0xc3296956897c549d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919226.695155:0:15122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1497d4b/0xc3296956897c549d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919226.696378:0:15122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1497d4b/0xc3296956897c549d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919226.696415:0:15122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790919226.696513:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919226.696521:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1497d4b/0xc3296956897c549d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919226.696551:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac59800 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:2.0:1790919226.696555:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1497d4b/0xc3296956897c549d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919226.696565:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1497d4b/0xc3296956897c549d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919226.696580:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1497d4b/0xc3296956897c549d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919226.696587:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1497d4b/0xc3296956897c549d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919226.696603:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919226.696605:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919226.696606:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790919226.698137:0:15122:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790919226.698145:0:15122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd16e061/0xc3296956897c54a4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919226.701895:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=428s v=(0 0) 00010000:00010000:0.0:1790919226.701906:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919226.701915:0:15122:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd16e061/0xc3296956897c54a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919226.701934:0:15122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd16e061/0xc3296956897c54a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919226.701945:0:15122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd16e061/0xc3296956897c54a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919226.701952:0:15122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd16e061/0xc3296956897c54a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919226.701980:0:15122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790919226.702000:0:14428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919226.702006:0:14428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd16e061/0xc3296956897c54a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919226.702013:0:14428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac59000 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:0.0:1790919226.702018:0:14428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd16e061/0xc3296956897c54a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919226.702027:0:14428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd16e061/0xc3296956897c54a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919226.702059:0:14428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd16e061/0xc3296956897c54a4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919226.702066:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd16e061/0xc3296956897c54a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919226.702088:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919226.702090:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919226.702092:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790919226.705086:0:15122:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790919226.705097:0:15122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f38f766/0xc3296956897c54ab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.705113:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=428s v=(0 0) 00010000:00010000:1.0:1790919226.705118:0:15122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919226.705125:0:15122:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f38f766/0xc3296956897c54ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.705148:0:15122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f38f766/0xc3296956897c54ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.705158:0:15122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f38f766/0xc3296956897c54ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.705166:0:15122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f38f766/0xc3296956897c54ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919226.705189:0:15122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1790919226.705393:0:15122:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:1.0:1790919226.705495:0:15122:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:14462:x1877914550368896:12345-0@lo:5:osp-pre-0-0.0 Request processed in 128277us (128459us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919226.705509:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1790919226.705810:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919226.705817:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f38f766/0xc3296956897c54ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919226.705826:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81517e00 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:2.0:1790919226.705831:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f38f766/0xc3296956897c54ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919226.705853:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f38f766/0xc3296956897c54ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919226.705870:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f38f766/0xc3296956897c54ab lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919226.705878:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f38f766/0xc3296956897c54ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919226.705895:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919226.705896:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919226.705898:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919226.707412:0:14462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac5fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14462:1877914550368896:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1790919226.707430:0:14462:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:1.0:1790919226.707490:0:14462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b39880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14462:1877914550369024:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1790919226.707576:0:14462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919226.707632:0:14462:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bebfbc9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790919226.708420:0:15124:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550369024 00000100:00100000:2.0:1790919226.708428:0:15124:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550369024 00000100:00100000:2.0:1790919226.708495:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790919226.708512:0:15124:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:14462:x1877914550369024:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1790919226.708576:0:15124:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:2.0:1790919226.730983:0:15124:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14462:x1877914550369024:12345-0@lo:5:osp-pre-0-0.0 Request processed in 22466us (23400us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1790919226.730997:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790919226.731372:0:14462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b39880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14462:1877914550369024:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1790919226.731389:0:14462:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:0.0:1790919227.263762:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919228.287822:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919229.312467:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919230.335757:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919231.360048:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790919231.747641:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790919231.747647:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1790919231.747651:0:8:0:(import.c:65:import_set_state_nolock()) ffff88be92816000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790919231.747659:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 428 00000100:00080000:1.0:1790919231.747685:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1790919231.747697:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88be92816000 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:1.0:1790919231.747718:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88beb3b38380 x1877914550369536/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790919231.755777:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550369152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790919231.756918:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919231.761829:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877914550369664:0@lo:400:kworker.0 00000100:00100000:3.0:1790919231.761907:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919231.761977:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:78fab146-b05d-43bc-9885-013f4b87a754:3305:1877914550369280:0@lo:400:kworker.0 00000100:00100000:3.0:1790919231.762018:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919231.762051:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790919231.762058:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550369408:0@lo:400:kworker.0 00000100:00100000:3.0:1790919231.762083:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919231.762115:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1877914550369536:0@lo:8:kworker.0 00000100:00100000:3.0:1790919231.762155:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919231.762189:0:14439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550369664 00000100:00100000:3.0:1790919231.762196:0:14439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550369664 00000100:00100000:3.0:1790919231.762239:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790919231.762450:0:14432:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550369280 00000100:00100000:0.0:1790919231.762455:0:14432:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550369280 00000100:00100000:0.0:1790919231.762484:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790919231.762491:0:14432:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78fab146-b05d-43bc-9885-013f4b87a754+16:3305:x1877914550369280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919231.762580:0:14432:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78fab146-b05d-43bc-9885-013f4b87a754+16:3305:x1877914550369280:12345-0@lo:400:kworker.0 Request processed in 89us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919231.762588:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790919231.762665:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:78fab146-b05d-43bc-9885-013f4b87a754:3305:1877914550369280:0@lo:400:kworker.0 00000100:00100000:3.0:1790919231.764619:0:14439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf789880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877914550369664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919231.766359:0:14439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf789880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877914550369664:12345-0@lo:400:kworker.0 Request processed in 3251us (3590us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919231.766379:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790919231.766449:0:15122:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550369408 00000100:00100000:3.0:1790919231.766459:0:15122:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550369408 00000100:00100000:3.0:1790919231.766522:0:15122:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550369536 00000100:00100000:3.0:1790919231.766540:0:15122:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550369536 00000100:00100000:3.0:1790919231.766556:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790919231.766564:0:15122:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf78a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1877914550369408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919231.766636:0:15122:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf78a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1877914550369408:12345-0@lo:400:kworker.0 Request processed in 73us (4551us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919231.766642:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790919231.766655:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790919231.766658:0:15122:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf788380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1877914550369536:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1790919231.767475:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550369408:0@lo:400:kworker.0 00000100:00100000:0.0:1790919231.767885:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1877914550369792:0@lo:400:kworker.0 00000100:00100000:0.0:1790919231.767948:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919231.769173:0:15126:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550369152 00000100:00100000:1.0:1790919231.769183:0:15126:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550369152 00000100:00100000:1.0:1790919231.769235:0:15126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790919231.769244:0:15126:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1877914550369152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790919231.769278:0:15126:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919231.769337:0:15126:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1877914550369152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (12423us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919231.769345:0:15126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00020000:3.0:1790919231.770792:0:15122:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1790919231.777936:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550369152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790919231.794947:0:14440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550369792 00000100:00100000:0.0:1790919231.794964:0:14440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550369792 00000100:00100000:0.0:1790919231.795029:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790919231.795039:0:14440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877914550369792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919231.795133:0:14440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877914550369792:12345-0@lo:400:kworker.0 Request processed in 96us (27184us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919231.795141:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1790919231.795165:0:14435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790919231.795170:0:14435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790919231.809710:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88beb3b3b100 x1877914550369792/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919231.809731:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1877914550369792:0@lo:400:kworker.0 00010000:00080000:2.0:1790919231.831069:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88beb3b39c00 x1877914550369664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919231.831089:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877914550369664:0@lo:400:kworker.0 00000100:00100000:3.0:1790919231.834063:0:15122:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf788380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1877914550369536:12345-0@lo:8:kworker.0 Request processed in 67394us (71898us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790919231.834090:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1790919231.834160:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88be92816000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790919231.834165:0:3304:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790919231.834169:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1877914550369536:0@lo:8:kworker.0 00000001:00080000:1.0:1790919231.899073:0:6722:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:2.0:1790919232.383811:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919233.407744:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790919233.667182:0:14472:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:2.0:1790919233.791666:0:15844:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790919233.791670:0:15844:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1790919233.791803:0:15844:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff88bebf872000 00000020:01000004:2.0:1790919233.791820:0:15844:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1790919233.791833:0:15844:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1790919233.791847:0:15844:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff88be88c70000) 00000020:00000080:2.0:1790919233.791863:0:15844:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1790919233.889810:0:15844:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1790919233.890089:0:15844:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1790919233.897038:0:15844:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1790919233.897363:0:15844:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1790919233.897630:0:15844:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1790919233.897981:0:15844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 353: rc = 0 00100000:10000000:0.0:1790919233.898079:0:15844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 353: rc = 0 00100000:10000000:0.0:1790919233.898176:0:15844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 353: rc = 0 00100000:10000000:0.0:1790919233.898638:0:15844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 534: rc = 0 00100000:10000000:0.0:1790919233.898969:0:15844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 534: rc = 0 00100000:10000000:0.0:1790919233.899216:0:15844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 534: rc = 0 00100000:10000000:0.0:1790919233.899472:0:15844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 534: rc = 0 00100000:10000000:0.0:1790919233.899769:0:15844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 534: rc = 0 00100000:10000000:0.0:1790919233.900011:0:15844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 534: rc = 0 00000020:00000080:1.0:1790919233.908078:0:15844:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1790919233.908105:0:15844:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1790919233.908116:0:15844:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc3296956897c54b9 00000020:01000004:1.0:1790919233.908123:0:15844:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1790919233.908144:0:15844:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.127@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1790919233.908147:0:15844:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.127@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1790919233.908153:0:15844:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1790919233.908193:0:15844:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1790919233.908197:0:15844:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.127@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1790919233.942327:0:15844:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.127@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790919233.942389:0:15844:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.127@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1790919233.942394:0:15844:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790919233.942396:0:15844:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790919233.942397:0:15844:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790919233.942399:0:15844:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790919233.942400:0:15844:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790919233.942401:0:15844:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790919233.942403:0:15844:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790919233.942404:0:15844:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790919233.942406:0:15844:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790919233.942410:0:15844:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1790919233.942412:0:15844:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790919233.942413:0:15844:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790919233.942415:0:15844:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790919233.942416:0:15844:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790919233.942417:0:15844:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790919233.942418:0:15844:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790919233.942419:0:15844:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790919233.942420:0:15844:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790919233.942421:0:15844:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790919233.942449:0:15844:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1790919233.942471:0:15844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15844:1877914550369920:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790919233.943446:0:15844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919233.943643:0:15844:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be91c84180 going to sleep for 11 seconds 00000100:00100000:3.0:1790919233.943951:0:14434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550369920 00000100:00100000:3.0:1790919233.943959:0:14434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550369920 00000100:00100000:3.0:1790919233.944048:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790919233.944058:0:14434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+16:15844:x1877914550369920:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1790919233.944125:0:14434:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1790919233.944128:0:14434:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1790919233.944132:0:14434:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1790919233.968319:0:14434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+16:15844:x1877914550369920:12345-0@lo:253:mount.lustre.0 Request processed in 24183us (24796us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919233.968335:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790919233.968467:0:15844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15844:1877914550369920:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790919233.968508:0:15844:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1790919233.968512:0:15844:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790919233.968513:0:15844:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790919233.968515:0:15844:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790919233.968516:0:15844:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790919233.968517:0:15844:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790919233.968519:0:15844:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790919233.968520:0:15844:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790919233.968621:0:15844:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790919233.968624:0:15844:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790919233.968648:0:15844:0:(tgt_mount.c:101:server_register_mount()) register mount ffff88bebf872000 from lustre-OST0001 10000000:01000000:2.0:1790919233.968678:0:15844:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1790919233.968681:0:15844:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1790919233.968689:0:15844:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff88be88d30000 local copy 00010000:00010000:2.0:1790919233.968700:0:15844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be90f9ea00/0xc3296956897c5266 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c526d expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919233.969064:0:15844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15844:1877914550370048:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790919233.969223:0:15844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919233.969383:0:15844:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be91c84000 going to sleep for 11 seconds 00000100:00100000:0.0:1790919233.969698:0:14433:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550370048 00000100:00100000:0.0:1790919233.969713:0:14433:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550370048 00000100:00100000:0.0:1790919233.969803:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790919233.969812:0:14433:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+16:15844:x1877914550370048:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790919233.970116:0:14433:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+16:15844:x1877914550370048:12345-0@lo:501:mount.lustre.0 Request processed in 305us (892us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790919233.970123:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790919233.970194:0:15844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15844:1877914550370048:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1790919233.970210:0:15844:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.127@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1790919233.970395:0:15844:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.127@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1790919233.970403:0:15844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be90f9ea00/0xc3296956897c5266 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c526d expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919233.970413:0:15844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88be90f9ea00/0xc3296956897c5266 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c526d expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919233.970438:0:15844:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff88bebf872000 10000000:01000000:1.0:1790919233.970443:0:15844:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790919233.970448:0:15844:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1790919233.970451:0:15844:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790919233.970455:0:15844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1790919233.970459:0:15844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1790919233.970483:0:15844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be81516e00/0xc3296956897c54c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919233.970501:0:15844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88be81516e00/0xc3296956897c54c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919233.970511:0:15844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88be81516e00/0xc3296956897c54c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919233.970885:0:15844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15844:1877914550370176:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790919233.970924:0:15844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919233.971406:0:15844:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be838f8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790919233.971493:0:14432:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550370176 00000100:00100000:2.0:1790919233.971500:0:14432:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550370176 00000100:00100000:2.0:1790919233.971660:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790919233.971670:0:14432:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78fab146-b05d-43bc-9885-013f4b87a754+16:15844:x1877914550370176:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790919233.971681:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919233.971695:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be90f9fc00/0xc3296956897c54c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c54c0 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919233.971717:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be90f9fc00/0xc3296956897c54c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c54c0 expref: 17 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919233.971726:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be90f9fc00/0xc3296956897c54c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c54c0 expref: 17 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919233.971740:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be90f9fc00, rc 0) 00000100:00100000:2.0:1790919233.971790:0:14432:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78fab146-b05d-43bc-9885-013f4b87a754+17:15844:x1877914550370176:12345-0@lo:101:mount.lustre.0 Request processed in 115us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919233.971796:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790919233.971921:0:15844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15844:1877914550370176:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790919233.971935:0:15844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88be81516e00/0xc3296956897c54c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c54c7 expref: -99 pid: 15844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919233.971944:0:15844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88be81516e00/0xc3296956897c54c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c54c7 expref: -99 pid: 15844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790919233.972796:0:15844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1790919233.973993:0:15844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790919233.974355:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1790919233.974401:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1790919233.974432:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1790919233.974481:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1790919233.974752:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1790919233.974898:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1790919233.974974:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1790919233.974981:0:15844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1790919233.975065:0:15844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15844:1877914550370304:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790919233.975279:0:15844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919233.975322:0:15844:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be838f86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790919233.975463:0:14434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550370304 00000100:00100000:3.0:1790919233.975471:0:14434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550370304 00000100:00100000:3.0:1790919233.975554:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790919233.975565:0:14434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba114450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+17:15844:x1877914550370304:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790919233.976042:0:14434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba114450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+17:15844:x1877914550370304:12345-0@lo:501:mount.lustre.0 Request processed in 478us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919233.976050:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790919233.976843:0:15844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15844:1877914550370304:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790919233.976894:0:15844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15844:1877914550370432:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790919233.976946:0:15844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919233.976980:0:15844:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be838f86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790919233.977086:0:14434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550370432 00000100:00100000:3.0:1790919233.977101:0:14434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550370432 00000100:00100000:3.0:1790919233.977145:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790919233.977154:0:14434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba117c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+17:15844:x1877914550370432:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790919233.977505:0:14434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba117c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+17:15844:x1877914550370432:12345-0@lo:503:mount.lustre.0 Request processed in 351us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919233.977513:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790919233.977969:0:15844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15844:1877914550370432:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790919233.978943:0:15844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790919233.979044:0:15844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15844:1877914550370560:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790919233.979344:0:15844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919233.979434:0:15844:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be838f86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919233.981441:0:14433:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550370560 00000100:00100000:0.0:1790919233.981454:0:14433:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550370560 00000100:00100000:1.0:1790919233.981976:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790919233.981988:0:14433:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba117050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+17:15844:x1877914550370560:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790919233.982729:0:14433:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba117050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+17:15844:x1877914550370560:12345-0@lo:502:mount.lustre.0 Request processed in 741us (3382us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919233.982737:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790919233.986733:0:15844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15844:1877914550370560:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790919233.988315:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1790919233.988954:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1790919233.988997:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1790919233.989051:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1790919233.989088:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1790919233.989919:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1790919233.989971:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1790919233.990006:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1790919233.990050:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1790919233.990707:0:15844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15844:1877914550370688:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790919233.992178:0:15844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919233.992294:0:15844:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be91c84a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790919233.998732:0:14432:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550370688 00000100:00100000:0.0:1790919233.998752:0:14432:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550370688 00000100:00100000:0.0:1790919233.999710:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790919233.999728:0:14432:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78fab146-b05d-43bc-9885-013f4b87a754+17:15844:x1877914550370688:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790919234.000029:0:14432:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78fab146-b05d-43bc-9885-013f4b87a754+17:15844:x1877914550370688:12345-0@lo:502:mount.lustre.0 Request processed in 308us (7854us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919234.000037:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790919234.000166:0:15844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15844:1877914550370688:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790919234.000286:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1790919234.000305:0:15844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1790919234.002778:0:15845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790919234.002804:0:15845:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1790919234.002812:0:15845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919234.002815:0:15845:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1790919234.002821:0:15845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790919234.002859:0:15845:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff88beb5d719c0) 00000020:00000080:2.0:1790919234.002883:0:15845:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1790919234.002895:0:15845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790919234.002969:0:15845:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88bebf872000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1790919234.002977:0:15845:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790919234.002984:0:15845:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc3296956897c54d5 00010000:00010000:1.0:1790919234.017017:0:15845:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1790919234.019457:0:15845:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1790919234.028982:0:15845:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1790919234.037754:0:15845:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1790919234.037767:0:15845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790919234.037774:0:15845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919234.037776:0:15845:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1790919234.037780:0:15845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790919234.037785:0:15845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919234.037786:0:15845:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790919234.037789:0:15845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790919234.037791:0:15845:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1790919234.037794:0:15845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790919234.037796:0:15845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919234.037797:0:15845:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1790919234.037799:0:15845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790919234.037802:0:15845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919234.037803:0:15845:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790919234.037806:0:15845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1790919234.037868:0:15845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790919234.037872:0:15845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919234.037873:0:15845:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790919234.037877:0:15845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1790919234.038113:0:15844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1790919234.038144:0:15844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1790919234.038169:0:15844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be81516e00/0xc3296956897c54c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c54c7 expref: -99 pid: 15844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919234.038183:0:15844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88be81516e00/0xc3296956897c54c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c54c7 expref: -99 pid: 15844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919234.038191:0:15844:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88bebf872000 from 1 10000000:01000000:2.0:1790919234.038194:0:15844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790919234.038230:0:15844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be90f9f200/0xc3296956897c54dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919234.038239:0:15844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88be90f9f200/0xc3296956897c54dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919234.038250:0:15844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88be90f9f200/0xc3296956897c54dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919234.038285:0:15844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15844:1877914550370816:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790919234.038362:0:15844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919234.038402:0:15844:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be91c84840 going to sleep for 11 seconds 00000100:00100000:1.0:1790919234.038746:0:14433:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550370816 00000100:00100000:1.0:1790919234.038753:0:14433:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550370816 00000100:00100000:1.0:1790919234.038855:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790919234.038865:0:14433:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba115050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+17:15844:x1877914550370816:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790919234.038881:0:14433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919234.038897:0:14433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be81516600/0xc3296956897c54e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c54dc expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919234.038921:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be81516600/0xc3296956897c54e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c54dc expref: 18 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919234.038933:0:14433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be81516600/0xc3296956897c54e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c54dc expref: 18 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919234.038941:0:14433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81516600, rc 0) 00000100:00100000:1.0:1790919234.038989:0:14433:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba115050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+18:15844:x1877914550370816:12345-0@lo:101:mount.lustre.0 Request processed in 125us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919234.038996:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790919234.039103:0:15844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15844:1877914550370816:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790919234.039118:0:15844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88be90f9f200/0xc3296956897c54dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c54e3 expref: -99 pid: 15844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919234.039140:0:15844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88be90f9f200/0xc3296956897c54dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c54e3 expref: -99 pid: 15844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790919234.039744:0:15844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1790919234.040263:0:15844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790919234.040510:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1790919234.040581:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1790919234.040646:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1790919234.040655:0:15844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1790919234.040725:0:15844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15844:1877914550370944:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790919234.040783:0:15844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919234.044946:0:15844:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be91c84840 going to sleep for 11 seconds 00000100:00100000:0.0:1790919234.045192:0:14434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550370944 00000100:00100000:0.0:1790919234.045204:0:14434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550370944 00000100:00100000:0.0:1790919234.045264:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790919234.045273:0:14434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+18:15844:x1877914550370944:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790919234.045634:0:14434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+18:15844:x1877914550370944:12345-0@lo:501:mount.lustre.0 Request processed in 361us (4850us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919234.045643:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790919234.046110:0:15844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15844:1877914550370944:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790919234.046167:0:15844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15844:1877914550371072:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790919234.046231:0:15844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919234.046262:0:15844:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be91c84840 going to sleep for 11 seconds 00000100:00100000:0.0:1790919234.046486:0:14434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550371072 00000100:00100000:0.0:1790919234.046492:0:14434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550371072 00000100:00100000:0.0:1790919234.046522:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790919234.046562:0:14434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+18:15844:x1877914550371072:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790919234.046912:0:14434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+18:15844:x1877914550371072:12345-0@lo:503:mount.lustre.0 Request processed in 352us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919234.046926:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790919234.047832:0:15844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15844:1877914550371072:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790919234.048808:0:15844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790919234.048888:0:15844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15844:1877914550371200:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790919234.048963:0:15844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919234.049002:0:15844:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be91c84840 going to sleep for 11 seconds 00000100:00100000:0.0:1790919234.049364:0:14434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550371200 00000100:00100000:0.0:1790919234.049373:0:14434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550371200 00000100:00100000:0.0:1790919234.049410:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790919234.049419:0:14434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+18:15844:x1877914550371200:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790919234.049695:0:14434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+18:15844:x1877914550371200:12345-0@lo:502:mount.lustre.0 Request processed in 277us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919234.049704:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790919234.051384:0:15844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15844:1877914550371200:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790919234.051691:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1790919234.051770:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1790919234.051834:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1790919234.051885:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1790919234.051917:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1790919234.051961:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1790919234.051995:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1790919234.052027:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1790919234.052312:0:15844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15844:1877914550371328:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790919234.052397:0:15844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919234.052450:0:14434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550371328 00000100:00100000:2.0:1790919234.052456:0:14434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550371328 00000100:00100000:2.0:1790919234.052493:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790919234.052503:0:14434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+18:15844:x1877914550371328:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790919234.052710:0:14434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+18:15844:x1877914550371328:12345-0@lo:502:mount.lustre.0 Request processed in 207us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919234.052719:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790919234.052771:0:15844:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be91c84840 going to sleep for 11 seconds 00000100:00100000:2.0:1790919234.055291:0:15844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15844:1877914550371328:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790919234.055505:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1790919234.055521:0:15844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1790919234.062973:0:15849:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790919234.062988:0:15849:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919234.062990:0:15849:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790919234.062999:0:15849:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88bebf872000 00000020:00000080:1.0:1790919234.063002:0:15849:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790919234.063010:0:15849:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790919234.063013:0:15849:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919234.063015:0:15849:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1790919234.063017:0:15849:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790919234.063019:0:15849:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919234.063021:0:15849:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790919234.063024:0:15849:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88bebf872000 00000020:00000080:1.0:1790919234.063026:0:15849:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790919234.063099:0:15849:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790919234.063103:0:15849:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919234.063115:0:15849:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1790919234.063119:0:15849:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790919234.063122:0:15849:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919234.063124:0:15849:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790919234.063128:0:15849:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff88bebf872000 00000020:00000080:1.0:1790919234.063130:0:15849:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790919234.063170:0:15849:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790919234.063174:0:15849:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919234.063175:0:15849:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1790919234.063179:0:15849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1790919234.069482:0:15844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1790919234.069568:0:15844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790919234.069591:0:15844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be90f9f200/0xc3296956897c54dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c54e3 expref: -99 pid: 15844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919234.069605:0:15844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88be90f9f200/0xc3296956897c54dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c54e3 expref: -99 pid: 15844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919234.069665:0:15844:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790919234.069669:0:15844:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff88bebf872000 10000000:01000000:3.0:1790919234.069671:0:15844:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff88bebf872000 10000000:01000000:3.0:1790919234.069675:0:15844:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790919234.069682:0:15844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88bebf872000 from 1 10000000:01000000:3.0:1790919234.069684:0:15844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790919234.069720:0:15844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be813a3800/0xc3296956897c54ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919234.069728:0:15844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88be813a3800/0xc3296956897c54ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919234.069739:0:15844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88be813a3800/0xc3296956897c54ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919234.069761:0:15844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf78b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15844:1877914550371456:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790919234.072945:0:15844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919234.073009:0:15844:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb3f48000 going to sleep for 11 seconds 00000100:00100000:0.0:1790919234.074928:0:14434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550371456 00000100:00100000:0.0:1790919234.074942:0:14434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550371456 00000100:00100000:0.0:1790919234.075003:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790919234.075013:0:14434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+18:15844:x1877914550371456:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790919234.075031:0:14434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919234.075050:0:14434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88bebac58000/0xc3296956897c54f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c54ea expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919234.077226:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88bebac58000/0xc3296956897c54f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c54ea expref: 19 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919234.077243:0:14434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88bebac58000/0xc3296956897c54f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c54ea expref: 19 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919234.077252:0:14434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac58000, rc 0) 00000100:00100000:1.0:1790919234.078321:0:15844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf78b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15844:1877914550371456:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790919234.078509:0:15844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88be813a3800/0xc3296956897c54ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c54f1 expref: -99 pid: 15844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919234.078520:0:15844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88be813a3800/0xc3296956897c54ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c54f1 expref: -99 pid: 15844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919234.079168:0:14434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+19:15844:x1877914550371456:12345-0@lo:101:mount.lustre.0 Request processed in 3255us (5327us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919234.079180:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000040:00080000:1.0:1790919234.079187:0:15844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1790919234.079505:0:15844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790919234.080255:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1790919234.080313:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1790919234.080363:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1790919234.080413:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1790919234.080449:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1790919234.081810:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1790919234.081870:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1790919234.081924:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1790919234.081979:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1790919234.082032:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1790919234.082070:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1790919234.082119:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1790919234.082157:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1790919234.082203:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1790919234.082251:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1790919234.082287:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1790919234.082320:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1790919234.082378:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1790919234.082414:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1790919234.082447:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1790919234.085887:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1790919234.085973:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1790919234.086006:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1790919234.086076:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1790919234.091609:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1790919234.091691:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1790919234.091766:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1790919234.091810:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1790919234.091840:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1790919234.091888:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1790919234.091923:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1790919234.091955:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1790919234.091989:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1790919234.092038:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1790919234.092076:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1790919234.092137:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1790919234.092174:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1790919234.092286:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1790919234.092294:0:15844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1790919234.092411:0:15844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b3b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15844:1877914550371584:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790919234.092482:0:15844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919234.092560:0:15844:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be84f6e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790919234.102595:0:14432:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550371584 00000100:00100000:3.0:1790919234.102612:0:14432:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550371584 00000100:00100000:3.0:1790919234.102670:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790919234.102680:0:14432:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78fab146-b05d-43bc-9885-013f4b87a754+19:15844:x1877914550371584:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790919234.103014:0:14432:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78fab146-b05d-43bc-9885-013f4b87a754+19:15844:x1877914550371584:12345-0@lo:501:mount.lustre.0 Request processed in 335us (10531us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919234.103022:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790919234.103033:0:15844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b3b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15844:1877914550371584:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790919234.103086:0:15844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b3b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15844:1877914550371712:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790919234.103149:0:15844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919234.103180:0:15844:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be84f6e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790919234.110426:0:14433:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550371712 00000100:00100000:2.0:1790919234.110441:0:14433:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550371712 00000100:00100000:2.0:1790919234.110513:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790919234.110523:0:14433:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+19:15844:x1877914550371712:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790919234.110964:0:14433:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+19:15844:x1877914550371712:12345-0@lo:503:mount.lustre.0 Request processed in 441us (7813us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919234.110973:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790919234.153757:0:15844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b3b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15844:1877914550371712:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790919234.154507:0:15844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790919234.154626:0:15844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15844:1877914550371840:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790919234.154709:0:15844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919234.154752:0:15844:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be868ee600 going to sleep for 11 seconds 00000100:00100000:3.0:1790919234.154970:0:14433:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550371840 00000100:00100000:3.0:1790919234.154977:0:14433:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550371840 00000100:00100000:3.0:1790919234.155055:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790919234.155074:0:14433:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+19:15844:x1877914550371840:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790919234.155376:0:14433:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+19:15844:x1877914550371840:12345-0@lo:502:mount.lustre.0 Request processed in 304us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919234.155384:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790919234.156479:0:15844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15844:1877914550371840:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790919234.156775:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1790919234.156835:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1790919234.156870:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1790919234.156943:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1790919234.156982:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1790919234.157044:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1790919234.157102:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1790919234.157137:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1790919234.157199:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1790919234.157235:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1790919234.157269:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1790919234.157332:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1790919234.157384:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1790919234.157419:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1790919234.157467:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1790919234.157554:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1790919234.157597:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1790919234.157647:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1790919234.157679:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1790919234.157732:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1790919234.157786:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1790919234.157822:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1790919234.157854:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1790919234.157900:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1790919234.157938:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1790919234.157973:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1790919234.158042:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1790919234.158090:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1790919234.158123:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1790919234.158169:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1790919234.158208:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1790919234.158242:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1790919234.158277:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1790919234.161743:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1790919234.161802:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1790919234.161877:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1790919234.161908:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1790919234.161934:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1790919234.161971:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1790919234.161998:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1790919234.162077:0:15844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15844:1877914550371968:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790919234.162479:0:15844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919234.162787:0:15844:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be868ee600 going to sleep for 11 seconds 00000100:00100000:0.0:1790919234.162835:0:14434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550371968 00000100:00100000:0.0:1790919234.162851:0:14434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550371968 00000100:00100000:0.0:1790919234.162892:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790919234.162901:0:14434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+19:15844:x1877914550371968:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790919234.163406:0:14434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+19:15844:x1877914550371968:12345-0@lo:502:mount.lustre.0 Request processed in 504us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919234.163415:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790919234.163737:0:15844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15844:1877914550371968:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790919234.163848:0:15844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1790919234.163863:0:15844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1790919234.169510:0:15853:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1790919234.169676:0:15853:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff88beb5d70000) 00000020:00000080:2.0:1790919234.169699:0:15853:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1790919234.169786:0:15853:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88bebf872000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1790919234.169790:0:15853:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88bebf872000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1790919234.169794:0:15853:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88bebf872000 3 00010000:00080000:2.0:1790919234.169823:0:15853:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88bd8111d000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.127@tcp at head 00010000:00010000:2.0:1790919234.171477:0:15853:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1790919234.171709:0:15853:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1790919234.171742:0:15853:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790919234.171754:0:15853:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc3296956897c54ff 00000100:00080000:2.0:1790919234.171770:0:15853:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790919234.171781:0:15853:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88bd8111d000 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:2.0:1790919234.171815:0:15853:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88bebf74ce00 x1877914550372096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790919234.171840:0:15853:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1790919234.174676:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1877914550372096:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790919234.174778:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790919234.174900:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790919234.174905:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1790919234.174908:0:8:0:(import.c:65:import_set_state_nolock()) ffff88be92816000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790919234.174913:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 433 00000100:00080000:1.0:1790919234.174917:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1790919234.174926:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88be92816000 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:1.0:1790919234.174945:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88beb3b3b480 x1877914550372352/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790919234.174997:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1877914550372352:0@lo:8:kworker.0 00000100:00100000:1.0:1790919234.175026:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919234.175050:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790919234.175057:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1877914550372608:0@lo:400:kworker.0 00000100:00100000:1.0:1790919234.175091:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919234.175227:0:14440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550372096 00000100:00100000:0.0:1790919234.175237:0:14440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550372096 00000100:00100000:0.0:1790919234.175280:0:14440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550372608 00000100:00100000:0.0:1790919234.175283:0:14440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550372608 00000100:00100000:0.0:1790919234.175320:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790919234.175330:0:14440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877914550372608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919234.175374:0:14439:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1790919234.175382:0:14439:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1790919234.175418:0:14440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877914550372608:12345-0@lo:400:kworker.0 Request processed in 89us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919234.175426:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790919234.175443:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790919234.175447:0:14440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3304:x1877914550372096:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1790919234.175477:0:14440:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 436 last 0 00000100:00100000:3.0:1790919234.175480:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877914550372480:0@lo:400:kworker.0 00000100:00100000:3.0:1790919234.175509:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1790919234.175521:0:14440:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc3296956897c5506 00000100:00100000:3.0:1790919234.175656:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790919234.175665:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550372224:0@lo:400:kworker.0 00000100:00100000:3.0:1790919234.175689:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00100000:0.0:1790919234.175715:0:14440:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790919234.175752:0:14440:0:(import.c:65:import_set_state_nolock()) ffff88be86b75000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790919234.175795:0:14440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877914550372096:12345-0@lo:38:llog_process_th.0 Request processed in 345us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919234.175802:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790919234.175813:0:14440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550372480 00000100:00100000:0.0:1790919234.175816:0:14440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550372480 00000100:00100000:0.0:1790919234.175831:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790919234.175842:0:14440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf78ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877914550372480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919234.175887:0:14440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf78ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877914550372480:12345-0@lo:400:kworker.0 Request processed in 45us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919234.175892:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1790919234.175899:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88beb3b38e00 x1877914550372480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919234.175912:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877914550372480:0@lo:400:kworker.0 00000100:00080000:0.0:1790919234.175913:0:14435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790919234.175930:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88beb3b3b800 x1877914550372608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919234.175940:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1877914550372608:0@lo:400:kworker.0 00010000:00080000:0.0:1790919234.175974:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88bebf74ce00 x1877914550372096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790919244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919234.175982:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790919234.175988:0:3304:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1790919234.175995:0:3304:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1790919234.175999:0:3304:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790919234.176001:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88bd8111d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790919234.176006:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1877914550372096:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790919234.176595:0:15124:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550372352 00000100:00100000:0.0:1790919234.176600:0:15124:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550372352 00000100:00100000:0.0:1790919234.176624:0:15124:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550372224 00000100:00100000:0.0:1790919234.176627:0:15124:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550372224 00000100:00100000:1.0:1790919234.176722:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790919234.176731:0:15125:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf78bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550372224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919234.176778:0:15125:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf78bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550372224:12345-0@lo:400:kworker.0 Request processed in 48us (1087us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919234.176784:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790919234.176798:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790919234.176802:0:15125:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3304:x1877914550372352:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1790919234.176853:0:15125:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3304:x1877914550372352:12345-0@lo:8:kworker.0 Request processed in 49us (1826us total) trans 0 rc -11/-11 00000100:00100000:1.0:1790919234.176859:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790919234.177025:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790919234.177030:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88be92816000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790919234.177034:0:3304:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1790919234.177037:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1877914550372352:0@lo:8:kworker.0 00000100:00100000:3.0:1790919234.177116:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1790919234.177128:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550372224:0@lo:400:kworker.0 00000040:00080000:1.0:1790919234.177710:0:15853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1790919234.177768:0:15844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1790919234.177794:0:15844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790919234.177810:0:15844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be813a3800/0xc3296956897c54ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c54f1 expref: -99 pid: 15844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919234.177820:0:15844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88be813a3800/0xc3296956897c54ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c54f1 expref: -99 pid: 15844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790919234.177871:0:15844:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1790919234.177874:0:15844:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790919234.177875:0:15844:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790919234.177876:0:15844:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790919234.177878:0:15844:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790919234.177879:0:15844:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790919234.177881:0:15844:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790919234.177882:0:15844:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790919234.177884:0:15844:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790919234.177887:0:15844:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1790919234.177889:0:15844:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790919234.177891:0:15844:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790919234.177892:0:15844:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790919234.177893:0:15844:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790919234.177894:0:15844:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790919234.177895:0:15844:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790919234.177901:0:15844:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790919234.177902:0:15844:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790919234.177903:0:15844:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790919234.177922:0:15844:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1790919234.177936:0:15844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b3b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15844:1877914550372736:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1790919234.177981:0:15844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919234.178007:0:15844:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be84f6e480 going to sleep for 11 seconds 00000100:00080000:0.0:1790919234.178792:0:14435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790919234.178808:0:14434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550372736 00000100:00100000:0.0:1790919234.178814:0:14434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550372736 00000100:00100000:0.0:1790919234.178848:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790919234.178855:0:14434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+19:15844:x1877914550372736:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790919234.178888:0:14434:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1790919234.178907:0:14434:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1790919234.231627:0:14434:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790919234.231643:0:14434:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1790919234.231653:0:14455:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790919234.231667:0:14455:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790919234.231690:0:14455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88bebac59c00/0xc3296956897c550d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919234.231709:0:14455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88be813a2400/0xc3296956897c53e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c53e0 expref: 19 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919234.231718:0:14455:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88bebac59c00/0xc3296956897c550d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919234.231754:0:14455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88be813a2400/0xc3296956897c53e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3296956897c53e0 expref: 19 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919234.231767:0:14455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88be813a2400/0xc3296956897c53e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3296956897c53e0 expref: 19 pid: 14433 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919234.231781:0:14455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac5ca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14455:1877914550372864:0@lo:104: 00000100:00100000:0.0:1790919234.231843:0:14455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919234.231899:0:14455:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be9027d180 going to sleep for 11 seconds 00000100:00100000:3.0:1790919234.231956:0:14423:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550372864 00000100:00100000:3.0:1790919234.231978:0:14423:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550372864 00000100:00100000:3.0:1790919234.232025:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790919234.232035:0:14423:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:78fab146-b05d-43bc-9885-013f4b87a754+3:14455:x1877914550372864:12345-0@lo:104: 00010000:00010000:3.0:1790919234.232048:0:14423:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.127@tcp lock: ffff88be813a3c00/0xc3296956897c53e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c53e7 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919234.232108:0:14423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790919234.232113:0:14455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac5ca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14455:1877914550372864:0@lo:104: 00000100:00100000:3.0:1790919234.232114:0:14423:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:78fab146-b05d-43bc-9885-013f4b87a754+3:14455:x1877914550372864:12345-0@lo:104: Request processed in 81us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919234.232120:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1790919234.232130:0:14455:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88bebac59c00/0xc3296956897c550d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919234.232290:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919234.232296:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff88be813a3c00/0xc3296956897c53e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c53e7 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919234.232302:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be813a3c00 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:2.0:1790919234.232305:0:14429:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff88be813a3c00/0xc3296956897c53e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3296956897c53e7 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919234.232312:0:14429:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff88be813a3c00/0xc3296956897c53e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3296956897c53e7 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790919234.232317:0:14429:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff88be813a3c00/0xc3296956897c53e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3296956897c53e7 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919234.232320:0:14429:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790919234.232357:0:14429:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff88be813a3c00/0xc3296956897c53e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c53e7 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919234.232364:0:14429:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790919234.232393:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff88be813a3c00/0xc3296956897c53e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c53e7 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919234.232400:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff88be813a3c00/0xc3296956897c53e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c53e7 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919234.232426:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919234.232427:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919234.232428:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919234.232440:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:78fab146-b05d-43bc-9885-013f4b87a754:3308:1877914550372992:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790919234.232482:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919234.232554:0:14426:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550372992 00000100:00100000:0.0:1790919234.232559:0:14426:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550372992 00010000:00010000:0.0:1790919234.232577:0:14426:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88be813a2400/0xc3296956897c53e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c53e0 expref: 20 pid: 14433 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919234.232597:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790919234.232604:0:14426:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78fab146-b05d-43bc-9885-013f4b87a754+20:3308:x1877914550372992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790919234.232621:0:14426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919234.232626:0:14426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88be813a2400/0xc3296956897c53e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c53e0 expref: 20 pid: 14433 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919234.232636:0:14426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88be813a2400/0xc3296956897c53e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3296956897c53e0 expref: 20 pid: 14433 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919234.232648:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be813a2400/0xc3296956897c53e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3296956897c53e0 expref: 20 pid: 14433 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919234.232728:0:14426:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88bebac59c00/0xc3296956897c550d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919234.232736:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88bebac59c00/0xc3296956897c550d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790919234.232748:0:14426:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001081451s 00010000:00010000:0.0:1790919234.232753:0:14426:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88bebac59c00/0xc3296956897c550d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919234.232759:0:14426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88bebac59c00/0xc3296956897c550d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919234.232767:0:14426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88bebac59c00/0xc3296956897c550d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919234.232773:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88bebac59c00/0xc3296956897c550d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919234.232779:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac59c00 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:0.0:1790919234.232784:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88bebac59c00/0xc3296956897c550d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919234.232797:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88bebac59c00/0xc3296956897c550d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919234.232811:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88bebac59c00/0xc3296956897c550d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919234.232820:0:14426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919234.232856:0:14426:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78fab146-b05d-43bc-9885-013f4b87a754+19:3308:x1877914550372992:12345-0@lo:103:ldlm_bl.0 Request processed in 253us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919234.232863:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1790919234.232883:0:14455:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88bebac59c00/0xc3296956897c550d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919234.232891:0:14455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88bebac59c00/0xc3296956897c550d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919234.232897:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88bebac59c00/0xc3296956897c550d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919234.233160:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:78fab146-b05d-43bc-9885-013f4b87a754:3308:1877914550372992:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790919234.250639:0:15844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b3b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:78fab146-b05d-43bc-9885-013f4b87a754:15844:1877914550372736:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790919234.250659:0:15844:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1790919234.250663:0:15844:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790919234.250664:0:15844:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790919234.250666:0:15844:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790919234.250667:0:15844:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790919234.250668:0:15844:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790919234.250669:0:15844:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790919234.250671:0:15844:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790919234.250673:0:15844:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790919234.250674:0:15844:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790919234.250688:0:15844:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1790919234.251308:0:14434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+18:15844:x1877914550372736:12345-0@lo:253:mount.lustre.0 Request processed in 72451us (73323us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919234.251321:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00080000:10000000:0.0:1790919234.255805:0:15844:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1790919234.256062:0:15844:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1790919234.256291:0:15844:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1790919234.256460:0:15844:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1790919234.256689:0:15844:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1790919234.256989:0:15844:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1790919234.257842:0:15844:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1790919234.326077:0:15844:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1790919234.326097:0:15844:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1790919234.326135:0:15844:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790919234.326213:0:15844:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.127@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790919234.326227:0:15844:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1790919234.326428:0:15844:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1790919234.439407:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919235.456911:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790919236.171141:0:14436:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790919236.171149:0:14436:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88beb3f1f800 from 8 10000000:01000000:3.0:1790919236.171152:0:14436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790919236.171202:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be813a2e00/0xc3296956897c5514 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919236.171215:0:14436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88be813a2e00/0xc3296956897c5514 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919236.171226:0:14436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88be813a2e00/0xc3296956897c5514 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919236.171255:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf78b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:78fab146-b05d-43bc-9885-013f4b87a754:14436:1877914550373120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790919236.171338:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919236.171396:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bebbe2a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919236.174511:0:14433:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550373120 00000100:00100000:0.0:1790919236.174555:0:14433:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550373120 00000100:00100000:0.0:1790919236.174625:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790919236.174635:0:14433:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+18:14436:x1877914550373120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790919236.174654:0:14433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919236.174675:0:14433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88bebac59200/0xc3296956897c551b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c5514 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919236.174703:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88bebac59200/0xc3296956897c551b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c5514 expref: 19 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919236.174714:0:14433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88bebac59200/0xc3296956897c551b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c5514 expref: 19 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919236.174723:0:14433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac59200, rc 0) 00000100:00100000:0.0:1790919236.174819:0:14433:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+19:14436:x1877914550373120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (3481us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919236.174826:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790919236.175194:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf78b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:78fab146-b05d-43bc-9885-013f4b87a754:14436:1877914550373120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790919236.175215:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88be813a2e00/0xc3296956897c5514 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c551b expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919236.175244:0:14436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88be813a2e00/0xc3296956897c5514 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c551b expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919236.175328:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf78b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:78fab146-b05d-43bc-9885-013f4b87a754:14436:1877914550373248:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1790919236.175384:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919236.175434:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bebbe2a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919236.180752:0:14434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550373248 00000100:00100000:0.0:1790919236.180771:0:14434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550373248 00000100:00100000:0.0:1790919236.180841:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790919236.180852:0:14434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+19:14436:x1877914550373248:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1790919236.180880:0:14434:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790919236.180905:0:14434:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790919236.180909:0:14434:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1790919236.181091:0:14434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+19:14436:x1877914550373248:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 241us (5706us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919236.181100:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790919236.181602:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf78b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:78fab146-b05d-43bc-9885-013f4b87a754:14436:1877914550373248:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1790919236.181680:0:14436:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790919236.181690:0:14436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be813a2e00/0xc3296956897c5514 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c551b expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919236.181702:0:14436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88be813a2e00/0xc3296956897c5514 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c551b expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919236.485606:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919236.872835:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790919236.872859:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf789500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550373376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790919236.872930:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919236.873001:0:15126:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550373376 00000100:00100000:3.0:1790919236.873009:0:15126:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550373376 00000100:00100000:3.0:1790919236.873066:0:15126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790919236.873076:0:15126:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf789c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550373376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790919236.873111:0:15126:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919236.873155:0:15126:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf789c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550373376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919236.873163:0:15126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1790919236.873185:0:14435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790919236.873223:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf789500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550373376:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790919237.505772:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919238.527960:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790919239.429175:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790919239.429181:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1790919239.429196:0:8:0:(import.c:65:import_set_state_nolock()) ffff88be92816000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790919239.429214:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88be92816000 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:1.0:1790919239.429238:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88beb3b3bb80 x1877914550373760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790919239.429305:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:78fab146-b05d-43bc-9885-013f4b87a754:3306:1877914550373504:0@lo:400:kworker.0 00000100:00100000:1.0:1790919239.429702:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919239.429743:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1877914550374144:0@lo:400:kworker.0 00000100:00100000:1.0:1790919239.429767:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919239.429789:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790919239.429794:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1877914550374016:0@lo:400:kworker.0 00000100:00100000:1.0:1790919239.429810:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919239.429833:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550373632:0@lo:400:kworker.0 00000100:00100000:1.0:1790919239.429852:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919239.429866:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790919239.429870:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877914550373888:0@lo:400:kworker.0 00000100:00100000:1.0:1790919239.429885:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919239.429901:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1877914550373760:0@lo:8:kworker.0 00000100:00100000:1.0:1790919239.429921:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919239.429948:0:14432:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550373504 00000100:00100000:1.0:1790919239.429955:0:14432:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550373504 00000100:00100000:1.0:1790919239.429996:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790919239.430005:0:14432:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78fab146-b05d-43bc-9885-013f4b87a754+19:3306:x1877914550373504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919239.430052:0:14432:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78fab146-b05d-43bc-9885-013f4b87a754+19:3306:x1877914550373504:12345-0@lo:400:kworker.0 Request processed in 48us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919239.430059:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790919239.430094:0:14440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550374144 00000100:00100000:1.0:1790919239.430097:0:14440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550374144 00000100:00100000:1.0:1790919239.430132:0:14440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550374016 00000100:00100000:1.0:1790919239.430134:0:14440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550374016 00000100:00100000:1.0:1790919239.430146:0:14440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550373888 00000100:00100000:1.0:1790919239.430148:0:14440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550373888 00000100:00100000:1.0:1790919239.430159:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790919239.430164:0:14440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877914550374144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919239.430191:0:14440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877914550374144:12345-0@lo:400:kworker.0 Request processed in 27us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919239.430196:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790919239.430205:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790919239.430210:0:14440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877914550374016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919239.430228:0:14440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877914550374016:12345-0@lo:400:kworker.0 Request processed in 19us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919239.430233:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790919239.430241:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790919239.430245:0:14440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877914550373888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919239.430281:0:14440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877914550373888:12345-0@lo:400:kworker.0 Request processed in 36us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919239.430287:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790919239.430306:0:15125:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550373632 00000100:00100000:1.0:1790919239.430309:0:15125:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550373632 00000100:00100000:1.0:1790919239.430331:0:15125:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550373760 00000100:00100000:1.0:1790919239.430334:0:15125:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550373760 00000100:00100000:1.0:1790919239.430416:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790919239.430423:0:15125:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550373632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919239.430453:0:15125:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550373632:12345-0@lo:400:kworker.0 Request processed in 31us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919239.430466:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790919239.430478:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790919239.430481:0:15125:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3304:x1877914550373760:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1790919239.430502:0:15125:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 441 last 0 00000020:00000080:1.0:1790919239.430541:0:15125:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3296956897c5522 00002000:00100000:1.0:1790919239.430554:0:15125:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff88be91616800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1790919239.430557:0:15125:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1790919239.430560:0:15125:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1790919239.430839:0:15125:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1790919239.430859:0:15125:0:(import.c:65:import_set_state_nolock()) ffff88be91614800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790919239.430892:0:15125:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1877914550373760:12345-0@lo:8:kworker.0 Request processed in 409us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919239.430898:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1790919239.430922:0:14435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790919239.430926:0:14435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790919239.430954:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88beb3b3bb80 x1877914550373760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790919264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790919239.430969:0:3304:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1790919239.430975:0:3304:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1790919239.430979:0:3304:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1790919239.430981:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88be92816000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1790919239.430993:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1790919239.430998:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1877914550373760:0@lo:8:kworker.0 00000004:00080000:1.0:1790919239.431020:0:14463:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1790919239.431496:0:14464:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:2.0:1790919239.431515:0:14464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14464:1877914550374400:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1790919239.431564:0:14464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919239.431582:0:14464:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bd82c4e900 going to sleep for 11 seconds 00000100:00100000:2.0:1790919239.431591:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790919239.431599:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550374272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790919239.431623:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919239.431650:0:15126:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550374272 00000100:00100000:2.0:1790919239.431654:0:15126:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550374272 00000100:00100000:2.0:1790919239.431688:0:15126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790919239.431695:0:15126:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1877914550374272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790919239.431715:0:15126:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790919239.431747:0:15126:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1877914550374272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919239.431763:0:15126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1790919239.431795:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebf74f800 x1877914550374272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919255 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919239.431808:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550374272:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1790919239.431821:0:14435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790919239.431899:0:15125:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550374400 00000100:00100000:2.0:1790919239.431903:0:15125:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550374400 00000100:00100000:2.0:1790919239.431924:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790919239.431930:0:15125:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14464:x1877914550374400:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1790919239.434044:0:15125:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1790919239.434053:0:15125:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1790919239.434058:0:15125:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00000004:00080000:1.0:1790919239.434456:0:14463:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 441322928071ns, next at 0ns, rc = 0 00010000:00080000:1.0:1790919239.434521:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88beb3b38700 x1877914550373888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919239.434558:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877914550373888:0@lo:400:kworker.0 00000100:00100000:1.0:1790919239.434574:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550373632:0@lo:400:kworker.0 00010000:00080000:1.0:1790919239.434612:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88beb3b39500 x1877914550374016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919239.434622:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1877914550374016:0@lo:400:kworker.0 00000100:00100000:1.0:1790919239.434632:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:78fab146-b05d-43bc-9885-013f4b87a754:3306:1877914550373504:0@lo:400:kworker.0 00010000:00080000:1.0:1790919239.434644:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88beb3b3a300 x1877914550374144/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919239.434652:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1877914550374144:0@lo:400:kworker.0 00002000:00010000:2.0:1790919239.445459:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919239.445472:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cc233e3/0xc3296956897c5529 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.445489:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1790919239.445493:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919239.445500:0:15125:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009cc233e3/0xc3296956897c5529 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.445517:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009cc233e3/0xc3296956897c5529 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.445548:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cc233e3/0xc3296956897c5529 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.445569:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009cc233e3/0xc3296956897c5529 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.445588:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790919239.446102:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919239.446108:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006c4f8ca/0xc3296956897c5530 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.446118:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1790919239.446121:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919239.446125:0:15125:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006c4f8ca/0xc3296956897c5530 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.446134:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006c4f8ca/0xc3296956897c5530 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.446142:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006c4f8ca/0xc3296956897c5530 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.446150:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006c4f8ca/0xc3296956897c5530 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.446167:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1790919239.448837:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919239.448848:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c184c254/0xc3296956897c5537 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.448870:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1790919239.448875:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919239.448882:0:15125:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c184c254/0xc3296956897c5537 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.448896:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c184c254/0xc3296956897c5537 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.448907:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c184c254/0xc3296956897c5537 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.448915:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c184c254/0xc3296956897c5537 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.448926:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1790919239.449674:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919239.449681:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022317b3a/0xc3296956897c553e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.449691:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1790919239.449694:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919239.449699:0:15125:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022317b3a/0xc3296956897c553e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.449708:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022317b3a/0xc3296956897c553e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.449727:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022317b3a/0xc3296956897c553e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.449734:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022317b3a/0xc3296956897c553e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.449743:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1790919239.450120:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919239.450127:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7362843/0xc3296956897c5545 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.450135:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1790919239.450153:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919239.450157:0:15125:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7362843/0xc3296956897c5545 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.450167:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7362843/0xc3296956897c5545 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.450176:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7362843/0xc3296956897c5545 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.450184:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7362843/0xc3296956897c5545 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.450204:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1790919239.450842:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919239.450848:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000156c0511/0xc3296956897c554c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.450859:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1790919239.450863:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919239.450867:0:15125:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000156c0511/0xc3296956897c554c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.450876:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000156c0511/0xc3296956897c554c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.450884:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000156c0511/0xc3296956897c554c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.450891:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000156c0511/0xc3296956897c554c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.450900:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1790919239.451241:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919239.451247:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1d2dcc0/0xc3296956897c5553 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.451268:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1790919239.451277:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919239.451281:0:15125:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1d2dcc0/0xc3296956897c5553 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.451290:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1d2dcc0/0xc3296956897c5553 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.451299:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1d2dcc0/0xc3296956897c5553 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.451306:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b1d2dcc0/0xc3296956897c5553 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.451315:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:3.0:1790919239.451537:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1790919239.451546:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009cc233e3/0xc3296956897c5529 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.451555:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be90f9f400 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:3.0:1790919239.451565:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009cc233e3/0xc3296956897c5529 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.451575:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009cc233e3/0xc3296956897c5529 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.451595:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009cc233e3/0xc3296956897c5529 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.451603:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009cc233e3/0xc3296956897c5529 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.451626:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1790919239.451630:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006c4f8ca/0xc3296956897c5530 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.451636:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be90f9ee00 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:3.0:1790919239.451639:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006c4f8ca/0xc3296956897c5530 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.451646:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006c4f8ca/0xc3296956897c5530 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.451655:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006c4f8ca/0xc3296956897c5530 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.451663:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006c4f8ca/0xc3296956897c5530 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.451682:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1790919239.451686:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c184c254/0xc3296956897c5537 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.451693:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be90f9f600 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:3.0:1790919239.451696:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c184c254/0xc3296956897c5537 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.451704:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c184c254/0xc3296956897c5537 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.451716:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c184c254/0xc3296956897c5537 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.451723:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c184c254/0xc3296956897c5537 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.451735:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1790919239.451738:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022317b3a/0xc3296956897c553e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.451746:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be90f9e000 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:3.0:1790919239.451750:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022317b3a/0xc3296956897c553e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.451768:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022317b3a/0xc3296956897c553e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.451779:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022317b3a/0xc3296956897c553e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.451786:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022317b3a/0xc3296956897c553e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.451798:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1790919239.451802:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7362843/0xc3296956897c5545 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.451808:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be90f9fa00 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:3.0:1790919239.451811:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7362843/0xc3296956897c5545 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.451818:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7362843/0xc3296956897c5545 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.451828:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7362843/0xc3296956897c5545 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.451836:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7362843/0xc3296956897c5545 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.451858:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790919239.451861:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000156c0511/0xc3296956897c554c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.451867:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be90f9ec00 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:3.0:1790919239.451870:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000156c0511/0xc3296956897c554c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.451878:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000156c0511/0xc3296956897c554c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.451887:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000156c0511/0xc3296956897c554c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.451894:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000156c0511/0xc3296956897c554c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.451904:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790919239.451907:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b1d2dcc0/0xc3296956897c5553 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.451913:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be90f9e200 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:3.0:1790919239.451916:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1d2dcc0/0xc3296956897c5553 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.451934:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1d2dcc0/0xc3296956897c5553 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.451944:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b1d2dcc0/0xc3296956897c5553 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.451950:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1d2dcc0/0xc3296956897c5553 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.451963:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919239.451964:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919239.451966:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790919239.454482:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919239.454493:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000574e3dab/0xc3296956897c555a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.454509:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1790919239.454513:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919239.454519:0:15125:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000574e3dab/0xc3296956897c555a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.454566:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000574e3dab/0xc3296956897c555a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.454576:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000574e3dab/0xc3296956897c555a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.454591:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000574e3dab/0xc3296956897c555a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.454612:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790919239.454993:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919239.455192:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790919239.455199:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000574e3dab/0xc3296956897c555a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.455209:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386a00 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:3.0:1790919239.455213:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000574e3dab/0xc3296956897c555a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.455224:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000574e3dab/0xc3296956897c555a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.455240:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000574e3dab/0xc3296956897c555a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.455270:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000574e3dab/0xc3296956897c555a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.455290:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919239.455293:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919239.455294:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919239.455845:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919239.456112:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a04d066/0xc3296956897c5561 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.456125:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1790919239.456129:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919239.456135:0:15125:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a04d066/0xc3296956897c5561 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.456147:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a04d066/0xc3296956897c5561 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.456155:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a04d066/0xc3296956897c5561 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.456162:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a04d066/0xc3296956897c5561 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.456182:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790919239.456680:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919239.456687:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000361092be/0xc3296956897c5568 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.456702:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1790919239.456705:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919239.456709:0:15125:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000361092be/0xc3296956897c5568 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.456719:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000361092be/0xc3296956897c5568 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.456728:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000361092be/0xc3296956897c5568 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.456735:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000361092be/0xc3296956897c5568 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.456750:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1790919239.456760:0:14428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790919239.456765:0:14428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a04d066/0xc3296956897c5561 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.456772:0:14428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88387e00 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:2.0:1790919239.456776:0:14428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a04d066/0xc3296956897c5561 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.456785:0:14428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a04d066/0xc3296956897c5561 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.456808:0:14428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a04d066/0xc3296956897c5561 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.456815:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a04d066/0xc3296956897c5561 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.456829:0:14428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919239.456832:0:14428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000361092be/0xc3296956897c5568 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.456839:0:14428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88387800 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:2.0:1790919239.456842:0:14428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000361092be/0xc3296956897c5568 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.456849:0:14428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000361092be/0xc3296956897c5568 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.456857:0:14428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000361092be/0xc3296956897c5568 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.456863:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000361092be/0xc3296956897c5568 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.456872:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919239.456874:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919239.456880:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790919239.457383:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919239.457390:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b39000b5/0xc3296956897c556f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.457399:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1790919239.457402:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919239.457406:0:15125:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b39000b5/0xc3296956897c556f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.457416:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b39000b5/0xc3296956897c556f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.457423:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b39000b5/0xc3296956897c556f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.457429:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b39000b5/0xc3296956897c556f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.457441:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790919239.457448:0:14428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919239.457451:0:14428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b39000b5/0xc3296956897c556f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.457457:0:14428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386800 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:2.0:1790919239.457460:0:14428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b39000b5/0xc3296956897c556f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.457476:0:14428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b39000b5/0xc3296956897c556f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.457487:0:14428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b39000b5/0xc3296956897c556f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.457494:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b39000b5/0xc3296956897c556f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.457505:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919239.457506:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919239.457508:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790919239.457898:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919239.457904:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002b9ac04/0xc3296956897c5576 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.457913:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1790919239.457917:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919239.457921:0:15125:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002b9ac04/0xc3296956897c5576 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.457929:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002b9ac04/0xc3296956897c5576 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.457936:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002b9ac04/0xc3296956897c5576 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.457949:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002b9ac04/0xc3296956897c5576 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.457961:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790919239.457969:0:14428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919239.457972:0:14428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002b9ac04/0xc3296956897c5576 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.457979:0:14428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88387600 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:2.0:1790919239.457982:0:14428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002b9ac04/0xc3296956897c5576 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.457990:0:14428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002b9ac04/0xc3296956897c5576 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.458372:0:14428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002b9ac04/0xc3296956897c5576 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.458381:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002b9ac04/0xc3296956897c5576 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.458395:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919239.458397:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919239.458398:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790919239.458832:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919239.458844:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053262656/0xc3296956897c557d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.458854:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1790919239.458857:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919239.458862:0:15125:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053262656/0xc3296956897c557d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.458870:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053262656/0xc3296956897c557d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.458877:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053262656/0xc3296956897c557d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.458884:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053262656/0xc3296956897c557d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.458897:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790919239.458906:0:14428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919239.458909:0:14428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053262656/0xc3296956897c557d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.458916:0:14428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386400 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:2.0:1790919239.458920:0:14428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053262656/0xc3296956897c557d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.458927:0:14428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053262656/0xc3296956897c557d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.458943:0:14428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053262656/0xc3296956897c557d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.458950:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053262656/0xc3296956897c557d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.458963:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919239.458964:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919239.458966:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919239.459076:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790919239.463656:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919239.463668:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9ee6862/0xc3296956897c5584 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.463687:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1790919239.463692:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919239.463698:0:15125:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9ee6862/0xc3296956897c5584 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.463712:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9ee6862/0xc3296956897c5584 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.463724:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9ee6862/0xc3296956897c5584 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.463733:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9ee6862/0xc3296956897c5584 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.463768:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790919239.463783:0:14428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919239.463789:0:14428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9ee6862/0xc3296956897c5584 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.463796:0:14428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88387000 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:2.0:1790919239.463801:0:14428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9ee6862/0xc3296956897c5584 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.463811:0:14428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9ee6862/0xc3296956897c5584 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.463825:0:14428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9ee6862/0xc3296956897c5584 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.463833:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9ee6862/0xc3296956897c5584 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.463854:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919239.463855:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919239.463857:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790919239.466522:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919239.467292:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b39000b5/0xc3296956897c558b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.467310:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1790919239.467323:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919239.467330:0:15125:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b39000b5/0xc3296956897c558b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.468093:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b39000b5/0xc3296956897c558b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.468106:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b39000b5/0xc3296956897c558b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.468115:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b39000b5/0xc3296956897c558b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.475569:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790919239.475590:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919239.475598:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b39000b5/0xc3296956897c558b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.475611:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386800 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:2.0:1790919239.475616:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b39000b5/0xc3296956897c558b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.475629:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b39000b5/0xc3296956897c558b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.475650:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b39000b5/0xc3296956897c558b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.475670:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b39000b5/0xc3296956897c558b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.475691:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919239.475693:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919239.475694:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790919239.478421:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919239.478437:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002b9ac04/0xc3296956897c5592 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.478454:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1790919239.478458:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919239.478465:0:15125:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002b9ac04/0xc3296956897c5592 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.478480:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002b9ac04/0xc3296956897c5592 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.478488:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002b9ac04/0xc3296956897c5592 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.478495:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002b9ac04/0xc3296956897c5592 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.478513:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790919239.478543:0:14428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919239.478559:0:14428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002b9ac04/0xc3296956897c5592 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.478566:0:14428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88387600 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:2.0:1790919239.478570:0:14428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002b9ac04/0xc3296956897c5592 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.478579:0:14428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002b9ac04/0xc3296956897c5592 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.478596:0:14428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002b9ac04/0xc3296956897c5592 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.478604:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002b9ac04/0xc3296956897c5592 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.478622:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919239.478624:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919239.478626:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790919239.479915:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919239.479925:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000361092be/0xc3296956897c5599 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.479937:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1790919239.479941:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919239.479946:0:15125:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000361092be/0xc3296956897c5599 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.479969:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000361092be/0xc3296956897c5599 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.479977:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000361092be/0xc3296956897c5599 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.479985:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000361092be/0xc3296956897c5599 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.480443:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790919239.480919:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919239.480926:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a04d066/0xc3296956897c55a0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.480937:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1790919239.480940:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919239.480945:0:15125:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a04d066/0xc3296956897c55a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.480954:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a04d066/0xc3296956897c55a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.480962:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a04d066/0xc3296956897c55a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.480981:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a04d066/0xc3296956897c55a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919239.486517:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790919239.486544:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000361092be/0xc3296956897c5599 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919239.486558:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88387800 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:0.0:1790919239.486563:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000361092be/0xc3296956897c5599 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919239.486575:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000361092be/0xc3296956897c5599 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919239.486598:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000361092be/0xc3296956897c5599 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919239.486606:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000361092be/0xc3296956897c5599 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.491509:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790919239.492111:0:14428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919239.492121:0:14428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a04d066/0xc3296956897c55a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919239.492135:0:14428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88387e00 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:1.0:1790919239.492141:0:14428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a04d066/0xc3296956897c55a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919239.492152:0:14428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a04d066/0xc3296956897c55a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919239.492176:0:14428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a04d066/0xc3296956897c55a0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919239.492195:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a04d066/0xc3296956897c55a0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919239.492215:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919239.492216:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919239.492218:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919239.492731:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919239.492735:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919239.492737:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790919239.493645:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919239.493655:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9ee6862/0xc3296956897c55a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.493670:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1790919239.493675:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919239.493681:0:15125:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9ee6862/0xc3296956897c55a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.493693:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9ee6862/0xc3296956897c55a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.493702:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9ee6862/0xc3296956897c55a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.493710:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9ee6862/0xc3296956897c55a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.493730:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790919239.494235:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919239.494242:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053262656/0xc3296956897c55ae lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.494270:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1790919239.494274:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919239.494279:0:15125:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053262656/0xc3296956897c55ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.494290:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053262656/0xc3296956897c55ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.494299:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053262656/0xc3296956897c55ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.494307:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053262656/0xc3296956897c55ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.494322:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1790919239.494801:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919239.494809:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d928183b/0xc3296956897c55b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.494818:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1790919239.494821:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919239.494826:0:15125:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d928183b/0xc3296956897c55b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.494836:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d928183b/0xc3296956897c55b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.494855:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d928183b/0xc3296956897c55b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.494863:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d928183b/0xc3296956897c55b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.494872:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1790919239.498669:0:14428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790919239.498682:0:14428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9ee6862/0xc3296956897c55a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919239.498696:0:14428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88387000 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:1.0:1790919239.498700:0:14428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9ee6862/0xc3296956897c55a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919239.498710:0:14428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9ee6862/0xc3296956897c55a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919239.498732:0:14428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9ee6862/0xc3296956897c55a7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919239.498739:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9ee6862/0xc3296956897c55a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919239.498776:0:14428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790919239.498780:0:14428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053262656/0xc3296956897c55ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919239.498786:0:14428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386400 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:1.0:1790919239.498789:0:14428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053262656/0xc3296956897c55ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919239.498795:0:14428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053262656/0xc3296956897c55ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919239.498805:0:14428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053262656/0xc3296956897c55ae lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919239.498812:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053262656/0xc3296956897c55ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919239.498824:0:14428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919239.498827:0:14428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d928183b/0xc3296956897c55b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919239.498833:0:14428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386200 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:1.0:1790919239.498837:0:14428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d928183b/0xc3296956897c55b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919239.498855:0:14428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d928183b/0xc3296956897c55b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919239.498866:0:14428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d928183b/0xc3296956897c55b5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919239.498873:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d928183b/0xc3296956897c55b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919239.498885:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919239.498887:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919239.498889:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919239.498925:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790919239.501799:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919239.501811:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b39000b5/0xc3296956897c55bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.501827:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1790919239.501834:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919239.501840:0:15125:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b39000b5/0xc3296956897c55bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.501854:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b39000b5/0xc3296956897c55bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.501864:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b39000b5/0xc3296956897c55bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.501871:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b39000b5/0xc3296956897c55bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.501901:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790919239.501914:0:14428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919239.501919:0:14428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b39000b5/0xc3296956897c55bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.501927:0:14428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386800 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:2.0:1790919239.501931:0:14428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b39000b5/0xc3296956897c55bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.501941:0:14428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b39000b5/0xc3296956897c55bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.501955:0:14428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b39000b5/0xc3296956897c55bc lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.501962:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b39000b5/0xc3296956897c55bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.501978:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919239.501980:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919239.501981:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790919239.502426:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919239.502432:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fef9e70/0xc3296956897c55c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.502441:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1790919239.502448:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919239.502453:0:15125:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fef9e70/0xc3296956897c55c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.502461:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008fef9e70/0xc3296956897c55c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.502469:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fef9e70/0xc3296956897c55c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.502477:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008fef9e70/0xc3296956897c55c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.502493:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790919239.502899:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919239.502905:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e97d040/0xc3296956897c55ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.502914:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1790919239.502918:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919239.502921:0:15125:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e97d040/0xc3296956897c55ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.502931:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e97d040/0xc3296956897c55ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.502940:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e97d040/0xc3296956897c55ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.502952:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e97d040/0xc3296956897c55ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.502967:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1790919239.502978:0:14428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790919239.502983:0:14428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008fef9e70/0xc3296956897c55c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.502989:0:14428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386000 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:2.0:1790919239.502993:0:14428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008fef9e70/0xc3296956897c55c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.503002:0:14428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008fef9e70/0xc3296956897c55c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.503015:0:14428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008fef9e70/0xc3296956897c55c3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.503022:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008fef9e70/0xc3296956897c55c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.503037:0:14428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919239.503040:0:14428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e97d040/0xc3296956897c55ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.503057:0:14428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386e00 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:2.0:1790919239.503060:0:14428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e97d040/0xc3296956897c55ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.503069:0:14428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e97d040/0xc3296956897c55ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.503079:0:14428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e97d040/0xc3296956897c55ca lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.503085:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e97d040/0xc3296956897c55ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.503095:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919239.503097:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919239.503098:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790919239.503475:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919239.503481:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b864d4c7/0xc3296956897c55d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.503490:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1790919239.503493:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919239.503497:0:15125:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b864d4c7/0xc3296956897c55d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.503506:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b864d4c7/0xc3296956897c55d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.503521:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b864d4c7/0xc3296956897c55d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.503552:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b864d4c7/0xc3296956897c55d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.503565:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790919239.503574:0:14428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919239.503577:0:14428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b864d4c7/0xc3296956897c55d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.503584:0:14428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88387a00 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:2.0:1790919239.503587:0:14428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b864d4c7/0xc3296956897c55d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.503595:0:14428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b864d4c7/0xc3296956897c55d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.503607:0:14428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b864d4c7/0xc3296956897c55d1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.503614:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b864d4c7/0xc3296956897c55d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.503627:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919239.503633:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919239.503635:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790919239.504009:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919239.504015:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000955848a2/0xc3296956897c55d8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.504024:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1790919239.504028:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919239.504032:0:15125:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000955848a2/0xc3296956897c55d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.504042:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000955848a2/0xc3296956897c55d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.504050:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000955848a2/0xc3296956897c55d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.504058:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000955848a2/0xc3296956897c55d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.504073:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790919239.504080:0:14428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919239.504083:0:14428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000955848a2/0xc3296956897c55d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.504089:0:14428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386600 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:2.0:1790919239.504093:0:14428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000955848a2/0xc3296956897c55d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.504112:0:14428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000955848a2/0xc3296956897c55d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.504123:0:14428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000955848a2/0xc3296956897c55d8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.504132:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000955848a2/0xc3296956897c55d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.504145:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919239.504147:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919239.504148:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919239.509916:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790919239.518242:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919239.518268:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002b9ac04/0xc3296956897c55df lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.518286:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1790919239.518292:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919239.518299:0:15125:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002b9ac04/0xc3296956897c55df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.518313:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002b9ac04/0xc3296956897c55df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.518323:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002b9ac04/0xc3296956897c55df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.521106:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002b9ac04/0xc3296956897c55df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.521871:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790919239.522437:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919239.522445:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d16d6f18/0xc3296956897c55e6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.522461:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1790919239.522465:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919239.522472:0:15125:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d16d6f18/0xc3296956897c55e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.522485:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d16d6f18/0xc3296956897c55e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.522495:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d16d6f18/0xc3296956897c55e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.522504:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d16d6f18/0xc3296956897c55e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919239.522517:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:2.0:1790919239.522716:0:15125:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:2.0:1790919239.522807:0:15125:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14464:x1877914550374400:12345-0@lo:5:osp-pre-1-0.0 Request processed in 90873us (91238us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919239.522822:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790919239.522880:0:14464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14464:1877914550374400:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1790919239.522893:0:14464:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:2.0:1790919239.522933:0:14464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14464:1877914550374528:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1790919239.522965:0:14464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919239.523008:0:14464:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bd82c4e900 going to sleep for 11 seconds 00000100:00100000:2.0:1790919239.523023:0:15125:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550374528 00000100:00100000:2.0:1790919239.523028:0:15125:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550374528 00000100:00100000:2.0:1790919239.523058:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790919239.523066:0:15125:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14464:x1877914550374528:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1790919239.523099:0:15125:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:3.0:1790919239.524543:0:14428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790919239.524554:0:14428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002b9ac04/0xc3296956897c55df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.524567:0:14428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88387600 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:3.0:1790919239.524572:0:14428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002b9ac04/0xc3296956897c55df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.524583:0:14428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002b9ac04/0xc3296956897c55df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.524602:0:14428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002b9ac04/0xc3296956897c55df lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.524609:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002b9ac04/0xc3296956897c55df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.524628:0:14428:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790919239.524640:0:14428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d16d6f18/0xc3296956897c55e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.524647:0:14428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88387200 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:3.0:1790919239.524650:0:14428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d16d6f18/0xc3296956897c55e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.524659:0:14428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d16d6f18/0xc3296956897c55e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.524670:0:14428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d16d6f18/0xc3296956897c55e6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.524676:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d16d6f18/0xc3296956897c55e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919239.524689:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919239.524691:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919239.524693:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919239.525962:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919239.547416:0:15125:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14464:x1877914550374528:12345-0@lo:5:osp-pre-1-0.0 Request processed in 24343us (24443us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1790919239.547429:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790919239.547484:0:14464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14464:1877914550374528:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1790919239.547499:0:14464:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:3.0:1790919239.552729:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1790919239.564860:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:3.0:1790919240.579124:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790919241.516727:0:16202:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg127-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1790919241.603442:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919241.984205:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550374656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790919241.984290:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919241.984482:0:15126:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550374656 00000100:00100000:1.0:1790919241.984491:0:15126:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550374656 00000100:00100000:1.0:1790919241.984572:0:15126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790919241.984583:0:15126:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550374656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790919241.984618:0:15126:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919241.984665:0:15126:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550374656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919241.984673:0:15126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790919241.984722:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550374656:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790919241.986243:0:14435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790919242.634179:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919243.647889:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790919243.904474:0:14472:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1790919244.382954:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919244.383103:0:14433:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532552448 00000100:00100000:0.0:1790919244.383120:0:14433:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532552448 00000100:00100000:0.0:1790919244.383255:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 75 00000100:00100000:0.0:1790919244.383267:0:14433:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2349:x1877914532552448:12345-192.168.201.27@tcp:250:mount.lustre.0 00010000:00080000:0.0:1790919244.383324:0:14433:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 1f601f44-7343-45ca-9d5e-f7bb6777e55d@192.168.201.27@tcp t0 exp 0000000000000000 cur 446 last 0 00000020:00000080:0.0:1790919244.383383:0:14433:0:(genops.c:1384:class_connect()) connect: client 1f601f44-7343-45ca-9d5e-f7bb6777e55d, cookie 0xc3296956897c55ed 00000100:00080000:0.0:1790919244.383940:0:14433:0:(import.c:65:import_set_state_nolock()) ffff88bd82aa5800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790919244.384043:0:14433:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f601f44-7343-45ca-9d5e-f7bb6777e55d+5:2349:x1877914532552448:12345-192.168.201.27@tcp:250:mount.lustre.0 Request processed in 776us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919244.384068:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 75 00000100:00100000:2.0:1790919244.393887:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919244.393996:0:14434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532552576 00000100:00100000:1.0:1790919244.394016:0:14434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532552576 00000100:00100000:1.0:1790919244.394120:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 76 00000100:00100000:1.0:1790919244.394133:0:14434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f601f44-7343-45ca-9d5e-f7bb6777e55d+5:13714:x1877914532552576:12345-192.168.201.27@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790919244.394160:0:14434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919244.394195:0:14434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be81517c00/0xc3296956897c55f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8b413717672cf7e expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919244.394242:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be81517c00/0xc3296956897c55f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf7e expref: 6 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919244.394255:0:14434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be81517c00/0xc3296956897c55f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf7e expref: 6 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919244.394266:0:14434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81517c00, rc 0) 00000100:00100000:1.0:1790919244.394383:0:14434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f601f44-7343-45ca-9d5e-f7bb6777e55d+6:13714:x1877914532552576:12345-192.168.201.27@tcp:101:mount.lustre.0 Request processed in 252us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919244.394399:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 76 00000100:00100000:2.0:1790919244.397722:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919244.397832:0:14433:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532552704 00000100:00100000:0.0:1790919244.397843:0:14433:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532552704 00000100:00100000:0.0:1790919244.397906:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 77 00000100:00100000:0.0:1790919244.397925:0:14433:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f601f44-7343-45ca-9d5e-f7bb6777e55d+6:13714:x1877914532552704:12345-192.168.201.27@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790919244.398341:0:14433:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f601f44-7343-45ca-9d5e-f7bb6777e55d+6:13714:x1877914532552704:12345-192.168.201.27@tcp:501:mount.lustre.0 Request processed in 425us (627us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790919244.398349:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 77 00000100:00100000:3.0:1790919244.402215:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919244.402460:0:14432:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532552832 00000100:00100000:2.0:1790919244.402470:0:14432:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532552832 00000100:00100000:2.0:1790919244.402569:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 78 00000100:00100000:2.0:1790919244.402580:0:14432:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f601f44-7343-45ca-9d5e-f7bb6777e55d+6:13714:x1877914532552832:12345-192.168.201.27@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790919244.402598:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919244.402615:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be88386e00/0xc3296956897c55fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8b413717672cf85 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919244.402645:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be88386e00/0xc3296956897c55fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf85 expref: 7 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919244.402658:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be88386e00/0xc3296956897c55fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cf85 expref: 7 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919244.402667:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be88386e00, rc 0) 00000100:00100000:2.0:1790919244.404535:0:14432:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f601f44-7343-45ca-9d5e-f7bb6777e55d+7:13714:x1877914532552832:12345-192.168.201.27@tcp:101:mount.lustre.0 Request processed in 1937us (2314us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919244.404548:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 78 00000100:00100000:2.0:1790919244.411672:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919244.411828:0:14434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532552960 00000100:00100000:1.0:1790919244.411839:0:14434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532552960 00000100:00100000:1.0:1790919244.413191:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 79 00000100:00100000:1.0:1790919244.413211:0:14434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f601f44-7343-45ca-9d5e-f7bb6777e55d+7:13714:x1877914532552960:12345-192.168.201.27@tcp:501:mount.lustre.0 00000100:00100000:1.0:1790919244.413574:0:14434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f601f44-7343-45ca-9d5e-f7bb6777e55d+8:13714:x1877914532552960:12345-192.168.201.27@tcp:501:mount.lustre.0 Request processed in 370us (1911us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919244.413583:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 79 00000100:00100000:3.0:1790919244.418455:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919244.429686:0:14433:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532553088 00000100:00100000:0.0:1790919244.429710:0:14433:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532553088 00000100:00100000:0.0:1790919244.429789:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 80 00000100:00100000:0.0:1790919244.429799:0:14433:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f601f44-7343-45ca-9d5e-f7bb6777e55d+8:13714:x1877914532553088:12345-192.168.201.27@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790919244.430232:0:14433:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f601f44-7343-45ca-9d5e-f7bb6777e55d+8:13714:x1877914532553088:12345-192.168.201.27@tcp:503:mount.lustre.0 Request processed in 432us (11786us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919244.430241:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 80 00000100:00100000:3.0:1790919244.433995:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919244.434098:0:14433:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532553216 00000100:00100000:0.0:1790919244.434113:0:14433:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532553216 00000100:00100000:0.0:1790919244.434185:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 81 00000100:00100000:0.0:1790919244.434196:0:14433:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f601f44-7343-45ca-9d5e-f7bb6777e55d+8:13732:x1877914532553216:12345-192.168.201.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790919244.434608:0:14433:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f601f44-7343-45ca-9d5e-f7bb6777e55d+8:13732:x1877914532553216:12345-192.168.201.27@tcp:502:llog_process_th.0 Request processed in 413us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919244.434618:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 81 00000100:00100000:2.0:1790919244.470345:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919244.470442:0:14432:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532553344 00000100:00100000:3.0:1790919244.470475:0:14432:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532553344 00000100:00100000:3.0:1790919244.470564:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 82 00000100:00100000:3.0:1790919244.470577:0:14432:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f601f44-7343-45ca-9d5e-f7bb6777e55d+8:13732:x1877914532553344:12345-192.168.201.27@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790919244.470968:0:14432:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f601f44-7343-45ca-9d5e-f7bb6777e55d+8:13732:x1877914532553344:12345-192.168.201.27@tcp:502:llog_process_th.0 Request processed in 393us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919244.470977:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 82 00000100:00100000:3.0:1790919244.497903:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919244.498030:0:14434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532553472 00000100:00100000:1.0:1790919244.498057:0:14434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532553472 00000100:00100000:1.0:1790919244.498145:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 83 00000100:00100000:1.0:1790919244.498159:0:14434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f601f44-7343-45ca-9d5e-f7bb6777e55d+8:13714:x1877914532553472:12345-192.168.201.27@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790919244.498188:0:14434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919244.498208:0:14434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be81517800/0xc3296956897c5602 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8b413717672cfaf expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919244.498236:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be81517800/0xc3296956897c5602 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cfaf expref: 9 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919244.498247:0:14434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be81517800/0xc3296956897c5602 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cfaf expref: 9 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919244.498256:0:14434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81517800, rc 0) 00000100:00100000:1.0:1790919244.498334:0:14434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f601f44-7343-45ca-9d5e-f7bb6777e55d+9:13714:x1877914532553472:12345-192.168.201.27@tcp:101:mount.lustre.0 Request processed in 179us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919244.498342:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 83 00000100:00100000:1.0:1790919244.505245:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919244.505711:0:14433:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532553600 00000100:00100000:0.0:1790919244.505723:0:14433:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532553600 00000100:00100000:1.0:1790919244.505917:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 84 00000100:00100000:1.0:1790919244.505929:0:14433:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f601f44-7343-45ca-9d5e-f7bb6777e55d+9:13714:x1877914532553600:12345-192.168.201.27@tcp:256:mount.lustre.0 20000000:01000000:1.0:1790919244.505958:0:14433:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1790919244.505975:0:14433:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1790919244.505980:0:14433:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1790919244.505983:0:14433:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1790919244.505986:0:14433:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1790919244.508727:0:14433:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f601f44-7343-45ca-9d5e-f7bb6777e55d+9:13714:x1877914532553600:12345-192.168.201.27@tcp:256:mount.lustre.0 Request processed in 2790us (3481us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919244.508743:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 84 00000100:00100000:2.0:1790919244.512979:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919244.513218:0:14434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532553728 00000100:00100000:1.0:1790919244.513228:0:14434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532553728 00000100:00100000:1.0:1790919244.513290:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 85 00000100:00100000:1.0:1790919244.513301:0:14434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f601f44-7343-45ca-9d5e-f7bb6777e55d+9:13714:x1877914532553728:12345-192.168.201.27@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790919244.513318:0:14434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919244.513337:0:14434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be81517000/0xc3296956897c5609 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8b413717672cfb6 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919244.513368:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be81517000/0xc3296956897c5609 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cfb6 expref: 10 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919244.513380:0:14434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be81517000/0xc3296956897c5609 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cfb6 expref: 10 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919244.513389:0:14434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81517000, rc 0) 00000100:00100000:1.0:1790919244.513450:0:14434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f601f44-7343-45ca-9d5e-f7bb6777e55d+10:13714:x1877914532553728:12345-192.168.201.27@tcp:101:mount.lustre.0 Request processed in 151us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919244.513457:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 85 00000100:00100000:3.0:1790919244.516173:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919244.516406:0:14433:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532553856 00000100:00100000:1.0:1790919244.516417:0:14433:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532553856 00000100:00100000:1.0:1790919244.516482:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 86 00000100:00100000:1.0:1790919244.516491:0:14433:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f601f44-7343-45ca-9d5e-f7bb6777e55d+10:13714:x1877914532553856:12345-192.168.201.27@tcp:501:mount.lustre.0 00000100:00100000:1.0:1790919244.516793:0:14433:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f601f44-7343-45ca-9d5e-f7bb6777e55d+10:13714:x1877914532553856:12345-192.168.201.27@tcp:501:mount.lustre.0 Request processed in 302us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919244.516803:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 86 00000100:00100000:2.0:1790919244.518795:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919244.518872:0:14432:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532553984 00000100:00100000:3.0:1790919244.518880:0:14432:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532553984 00000100:00100000:3.0:1790919244.518937:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 87 00000100:00100000:3.0:1790919244.518946:0:14432:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f601f44-7343-45ca-9d5e-f7bb6777e55d+10:13714:x1877914532553984:12345-192.168.201.27@tcp:503:mount.lustre.0 00000100:00100000:3.0:1790919244.519334:0:14432:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f601f44-7343-45ca-9d5e-f7bb6777e55d+10:13714:x1877914532553984:12345-192.168.201.27@tcp:503:mount.lustre.0 Request processed in 387us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919244.519342:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 87 00000100:00100000:2.0:1790919244.522787:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919244.522882:0:14434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532554112 00000100:00100000:0.0:1790919244.522892:0:14434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532554112 00000100:00100000:0.0:1790919244.522953:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 88 00000100:00100000:0.0:1790919244.522963:0:14434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f601f44-7343-45ca-9d5e-f7bb6777e55d+10:13737:x1877914532554112:12345-192.168.201.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790919244.523285:0:14434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f601f44-7343-45ca-9d5e-f7bb6777e55d+10:13737:x1877914532554112:12345-192.168.201.27@tcp:502:llog_process_th.0 Request processed in 323us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919244.523293:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 88 00000100:00100000:0.0:1790919244.534732:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919244.534832:0:14433:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532554240 00000100:00100000:1.0:1790919244.534842:0:14433:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532554240 00000100:00100000:1.0:1790919244.534895:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 89 00000100:00100000:1.0:1790919244.534925:0:14433:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f601f44-7343-45ca-9d5e-f7bb6777e55d+10:13737:x1877914532554240:12345-192.168.201.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790919244.535196:0:14433:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f601f44-7343-45ca-9d5e-f7bb6777e55d+10:13737:x1877914532554240:12345-192.168.201.27@tcp:502:llog_process_th.0 Request processed in 281us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919244.535205:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 89 00000100:00100000:2.0:1790919244.541917:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919244.542620:0:14440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532554368 00000100:00100000:1.0:1790919244.542632:0:14440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532554368 00000100:00100000:1.0:1790919244.542686:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 4 00000100:00100000:1.0:1790919244.542695:0:14440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2349:x1877914532554368:12345-192.168.201.27@tcp:38:mount.lustre.0 00010000:00080000:1.0:1790919244.542726:0:14440:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from a397f618-6104-4fd0-addb-afcbd50d641f@192.168.201.27@tcp t0 exp 0000000000000000 cur 446 last 0 00000020:00000080:1.0:1790919244.542787:0:14440:0:(genops.c:1384:class_connect()) connect: client a397f618-6104-4fd0-addb-afcbd50d641f, cookie 0xc3296956897c5610 00000004:00100000:1.0:1790919244.542818:0:14440:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1790919244.542824:0:14440:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1790919244.553888:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf789500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550374784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790919244.553971:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919244.554032:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790919244.554039:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf78aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:78fab146-b05d-43bc-9885-013f4b87a754:3305:1877914550374912:0@lo:400:kworker.0 00000100:00100000:1.0:1790919244.554073:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919244.554404:0:15126:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550374784 00000100:00100000:1.0:1790919244.554413:0:15126:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550374784 00000100:00100000:1.0:1790919244.554474:0:15126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790919244.554484:0:15126:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1877914550374784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790919244.554523:0:15126:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919244.554615:0:15126:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1877914550374784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919244.554623:0:15126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790919244.554680:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf789500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550374784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790919244.554841:0:14432:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550374912 00000100:00100000:3.0:1790919244.554846:0:14432:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550374912 00000100:00100000:3.0:1790919244.554873:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1790919244.554879:0:14432:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78fab146-b05d-43bc-9885-013f4b87a754+19:3305:x1877914550374912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919244.554914:0:14432:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78fab146-b05d-43bc-9885-013f4b87a754+19:3305:x1877914550374912:12345-0@lo:400:kworker.0 Request processed in 34us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919244.554920:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1790919244.554946:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf78b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877914550375168:0@lo:400:kworker.0 00000100:00100000:3.0:1790919244.554974:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919244.554996:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790919244.555002:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf788000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550375040:0@lo:400:kworker.0 00000100:00100000:3.0:1790919244.555035:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919244.555060:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf78b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1877914550375424:0@lo:400:kworker.0 00000100:00100000:3.0:1790919244.555085:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919244.555104:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790919244.555109:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf789500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1877914550375296:0@lo:400:kworker.0 00000100:00100000:3.0:1790919244.555128:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919244.555150:0:14439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550375168 00000100:00100000:3.0:1790919244.555154:0:14439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550375168 00000100:00100000:3.0:1790919244.555185:0:14439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550375424 00000100:00100000:3.0:1790919244.555188:0:14439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550375424 00000100:00100000:3.0:1790919244.555201:0:14439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550375296 00000100:00100000:3.0:1790919244.555203:0:14439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550375296 00000100:00100000:3.0:1790919244.555216:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790919244.555221:0:14439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877914550375168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919244.555256:0:14439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877914550375168:12345-0@lo:400:kworker.0 Request processed in 34us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919244.555263:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790919244.555274:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790919244.555280:0:14439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877914550375424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919244.555306:0:14439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877914550375424:12345-0@lo:400:kworker.0 Request processed in 27us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919244.555313:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790919244.555322:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790919244.555327:0:14439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877914550375296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919244.555350:0:14439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877914550375296:12345-0@lo:400:kworker.0 Request processed in 24us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919244.555356:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790919244.555383:0:15124:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550375040 00000100:00100000:3.0:1790919244.555386:0:15124:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550375040 00000100:00100000:3.0:1790919244.555409:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790919244.555415:0:15124:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550375040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919244.555444:0:15124:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550375040:12345-0@lo:400:kworker.0 Request processed in 29us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919244.555451:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790919244.555479:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf788000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550375040:0@lo:400:kworker.0 00010000:00080000:3.0:1790919244.555490:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebf78b800 x1877914550375168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919244.555500:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf78b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877914550375168:0@lo:400:kworker.0 00010000:00080000:3.0:1790919244.555522:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebf789500 x1877914550375296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919244.555557:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf789500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1877914550375296:0@lo:400:kworker.0 00010000:00080000:3.0:1790919244.555567:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bebf78b100 x1877914550375424/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919244.555576:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf78b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1877914550375424:0@lo:400:kworker.0 00000100:00100000:3.0:1790919244.555601:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf78aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:78fab146-b05d-43bc-9885-013f4b87a754:3305:1877914550374912:0@lo:400:kworker.0 00000100:00080000:3.0:1790919244.555983:0:14435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790919244.555989:0:14435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790919244.555991:0:14435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790919244.653217:0:14440:0:(import.c:65:import_set_state_nolock()) ffff88be91612000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790919244.653465:0:14440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a397f618-6104-4fd0-addb-afcbd50d641f+6:2349:x1877914532554368:12345-192.168.201.27@tcp:38:mount.lustre.0 Request processed in 110768us (111560us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919244.653477:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 4 00000100:00100000:2.0:1790919244.663955:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919244.664057:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919244.664091:0:15856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532554496 00000100:00100000:2.0:1790919244.664101:0:15856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532554496 00000100:00100000:2.0:1790919244.664153:0:15856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532554624 00000100:00100000:2.0:1790919244.664156:0:15856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532554624 00000100:00100000:2.0:1790919244.664206:0:15856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 5 00000100:00100000:2.0:1790919244.664215:0:15856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a397f618-6104-4fd0-addb-afcbd50d641f+7:0:x1877914532554496:12345-192.168.201.27@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790919244.664257:0:15856:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790919244.664351:0:15856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a397f618-6104-4fd0-addb-afcbd50d641f+7:0:x1877914532554496:12345-192.168.201.27@tcp:41:mount.lustre.0 Request processed in 136us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919244.664359:0:15856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 5 00000100:00100000:2.0:1790919244.664376:0:15856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 6 00000100:00100000:2.0:1790919244.664383:0:15856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a397f618-6104-4fd0-addb-afcbd50d641f+6:13714:x1877914532554624:12345-192.168.201.27@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790919244.664393:0:15856:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790919244.664417:0:15856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a397f618-6104-4fd0-addb-afcbd50d641f+6:13714:x1877914532554624:12345-192.168.201.27@tcp:41:mount.lustre.0 Request processed in 35us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919244.664423:0:15856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 6 00000100:00080000:2.0:1790919244.664439:0:14435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790919244.668042:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919244.668208:0:15856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532554752 00000100:00100000:3.0:1790919244.668218:0:15856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532554752 00000100:00100000:3.0:1790919244.668264:0:15856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 7 00000100:00100000:3.0:1790919244.668283:0:15856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a397f618-6104-4fd0-addb-afcbd50d641f+6:13714:x1877914532554752:12345-192.168.201.27@tcp:40:mount.lustre.0 00000100:00100000:3.0:1790919244.668368:0:15856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a397f618-6104-4fd0-addb-afcbd50d641f+6:13714:x1877914532554752:12345-192.168.201.27@tcp:40:mount.lustre.0 Request processed in 96us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919244.668376:0:15856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 7 00010000:00010000:2.0:1790919244.673364:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919244.674019:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919244.674044:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919244.674069:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919244.674095:0:15125:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532554880 00000100:00100000:2.0:1790919244.674104:0:15125:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532554880 00000100:00100000:2.0:1790919244.674140:0:15125:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532555008 00000100:00100000:2.0:1790919244.674143:0:15125:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532555008 00000100:00100000:2.0:1790919244.674157:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 9 00000100:00100000:2.0:1790919244.674177:0:15125:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2349:x1877914532554880:12345-192.168.201.27@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790919244.674209:0:15125:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from a397f618-6104-4fd0-addb-afcbd50d641f@192.168.201.27@tcp t0 exp 0000000000000000 cur 446 last 0 00000020:00000080:2.0:1790919244.674237:0:15125:0:(genops.c:1384:class_connect()) connect: client a397f618-6104-4fd0-addb-afcbd50d641f, cookie 0xc3296956897c5617 00002000:00100000:2.0:1790919244.674249:0:15125:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a397f618-6104-4fd0-addb-afcbd50d641f/ffff88bd81118800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790919244.674300:0:15125:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790919244.674636:0:15125:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790919244.674666:0:15125:0:(import.c:65:import_set_state_nolock()) ffff88bd8111f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790919244.675465:0:15125:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a397f618-6104-4fd0-addb-afcbd50d641f+6:2349:x1877914532554880:12345-192.168.201.27@tcp:8:mount.lustre.0 Request processed in 1283us (1447us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919244.675476:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 9 00000100:00100000:2.0:1790919244.675503:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 10 00000100:00100000:2.0:1790919244.675508:0:15125:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2349:x1877914532555008:12345-192.168.201.27@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790919244.675556:0:15125:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from a397f618-6104-4fd0-addb-afcbd50d641f@192.168.201.27@tcp t0 exp 0000000000000000 cur 446 last 0 00000020:00000080:2.0:1790919244.675580:0:15125:0:(genops.c:1384:class_connect()) connect: client a397f618-6104-4fd0-addb-afcbd50d641f, cookie 0xc3296956897c561e 00002000:00100000:2.0:1790919244.675589:0:15125:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a397f618-6104-4fd0-addb-afcbd50d641f/ffff88bd8111c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790919244.675597:0:15125:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790919244.675877:0:15125:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:3.0:1790919244.676037:0:14442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532555136 00000100:00100000:3.0:1790919244.676043:0:14442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532555136 00000100:00100000:3.0:1790919244.676082:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 0 00000100:00100000:3.0:1790919244.676089:0:14442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a397f618-6104-4fd0-addb-afcbd50d641f+6:13714:x1877914532555136:12345-192.168.201.27@tcp:33:mount.lustre.0 00000004:00080000:1.0:1790919244.676918:0:14442:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 764us 00000100:00080000:2.0:1790919244.680209:0:15125:0:(import.c:65:import_set_state_nolock()) ffff88bd8111b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790919244.680506:0:15125:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a397f618-6104-4fd0-addb-afcbd50d641f+6:2349:x1877914532555008:12345-192.168.201.27@tcp:8:mount.lustre.0 Request processed in 4991us (6455us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919244.680519:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 10 00000001:00100000:1.0:1790919244.691231:0:7662:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1790919244.691249:0:7662:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000004:00200000:1.0:1790919244.694429:0:14442:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1790919244.694567:0:14442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a397f618-6104-4fd0-addb-afcbd50d641f+6:13714:x1877914532555136:12345-192.168.201.27@tcp:33:mount.lustre.0 Request processed in 18473us (20490us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919244.694582:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 0 00000100:00100000:1.0:1790919244.893652:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919244.895573:0:14440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532555264 00000100:00100000:2.0:1790919244.895586:0:14440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532555264 00000100:00100000:2.0:1790919244.895662:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 8 00000100:00100000:2.0:1790919244.895673:0:14440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a397f618-6104-4fd0-addb-afcbd50d641f+6:13758:x1877914532555264:12345-192.168.201.27@tcp:101:mkdir.0 00010000:00010000:2.0:1790919244.895695:0:14440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919244.895724:0:14440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386a00/0xc3296956897c5625 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672cfe0 expref: -99 pid: 14440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919244.895830:0:14440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387800/0xc3296956897c562c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919244.895844:0:14440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387800/0xc3296956897c562c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919244.895859:0:14440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387800/0xc3296956897c562c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919244.895895:0:14440:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790919244.895898:0:14440:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790919244.895933:0:14440:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387800/0xc3296956897c562c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919244.895960:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386a00/0xc3296956897c5625 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cfe0 expref: 8 pid: 14440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919244.895978:0:14440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387800/0xc3296956897c562c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cfe0 expref: 7 pid: 14440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919244.895987:0:14440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be8b621d00) 00010000:00010000:2.0:1790919244.895990:0:14440:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790919244.895993:0:14440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be88387800, rc 0) 00000100:00100000:2.0:1790919244.896063:0:14440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a397f618-6104-4fd0-addb-afcbd50d641f+7:13758:x1877914532555264:12345-192.168.201.27@tcp:101:mkdir.0 Request processed in 391us (2421us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919244.896069:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 8 00010000:00010000:0.0:1790919245.696139:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919246.722146:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919247.006981:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919247.007814:0:15856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532555392 00000100:00100000:3.0:1790919247.007825:0:15856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532555392 00000100:00100000:3.0:1790919247.007952:0:15856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 9 00000100:00100000:3.0:1790919247.007962:0:15856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a397f618-6104-4fd0-addb-afcbd50d641f+7:13811:x1877914532555392:12345-192.168.201.27@tcp:41:lfs.0 00000004:00000024:3.0:1790919247.008005:0:15856:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1790919247.008326:0:15856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a397f618-6104-4fd0-addb-afcbd50d641f+7:13811:x1877914532555392:12345-192.168.201.27@tcp:41:lfs.0 Request processed in 366us (1354us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919247.008332:0:15856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 9 00000100:00080000:2.0:1790919247.008834:0:14435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790919247.012352:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919247.012488:0:15126:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532555520 00000100:00100000:1.0:1790919247.012499:0:15126:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532555520 00000100:00100000:1.0:1790919247.012671:0:15126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 6 00000100:00100000:1.0:1790919247.012684:0:15126:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4264a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a397f618-6104-4fd0-addb-afcbd50d641f+6:13811:x1877914532555520:12345-192.168.201.27@tcp:13:lfs.0 00002000:00000024:1.0:1790919247.012727:0:15126:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919247.012817:0:15126:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4264a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a397f618-6104-4fd0-addb-afcbd50d641f+6:13811:x1877914532555520:12345-192.168.201.27@tcp:13:lfs.0 Request processed in 136us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919247.012825:0:15126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 6 00000100:00100000:1.0:1790919247.017262:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919247.017354:0:15126:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532555648 00000100:00100000:3.0:1790919247.017364:0:15126:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532555648 00000100:00080000:2.0:1790919247.017520:0:14435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790919247.017537:0:14435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790919247.018265:0:15126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 7 00000100:00100000:3.0:1790919247.018278:0:15126:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a397f618-6104-4fd0-addb-afcbd50d641f+6:13811:x1877914532555648:12345-192.168.201.27@tcp:13:lfs.0 00002000:00000024:3.0:1790919247.018323:0:15126:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919247.018420:0:15126:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a397f618-6104-4fd0-addb-afcbd50d641f+6:13811:x1877914532555648:12345-192.168.201.27@tcp:13:lfs.0 Request processed in 144us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919247.018428:0:15126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 7 00000100:00100000:1.0:1790919247.104544:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb4265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550375552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790919247.104618:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919247.104812:0:15126:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550375552 00000100:00100000:3.0:1790919247.104826:0:15126:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550375552 00000100:00100000:3.0:1790919247.104895:0:15126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790919247.104905:0:15126:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550375552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790919247.104928:0:15126:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919247.104979:0:15126:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550375552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919247.104986:0:15126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790919247.106156:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb4265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550375552:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790919247.106181:0:14435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1790919247.155359:0:6722:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a397f618-6104-4fd0-addb-afcbd50d641f 00000100:00100000:0.0:1790919247.188113:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919247.188224:0:14434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532555776 00000100:00100000:1.0:1790919247.188246:0:14434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532555776 00000100:00100000:1.0:1790919247.188312:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 91 00000100:00100000:1.0:1790919247.188323:0:14434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f601f44-7343-45ca-9d5e-f7bb6777e55d+10:13841:x1877914532555776:12345-192.168.201.27@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790919247.188340:0:14434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919247.188359:0:14434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be81516c00/0xc3296956897c5633 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8b413717672cfe7 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919247.188388:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be81516c00/0xc3296956897c5633 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cfe7 expref: 11 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919247.188400:0:14434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be81516c00/0xc3296956897c5633 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cfe7 expref: 11 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919247.188408:0:14434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81516c00, rc 0) 00000100:00100000:1.0:1790919247.188471:0:14434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f601f44-7343-45ca-9d5e-f7bb6777e55d+11:13841:x1877914532555776:12345-192.168.201.27@tcp:101:mount.lustre.0 Request processed in 150us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919247.188479:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 91 00000100:00100000:0.0:1790919247.205890:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919247.205994:0:14433:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532555904 00000100:00100000:3.0:1790919247.206004:0:14433:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532555904 00000100:00100000:3.0:1790919247.206072:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 92 00000100:00100000:3.0:1790919247.206082:0:14433:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f601f44-7343-45ca-9d5e-f7bb6777e55d+11:13841:x1877914532555904:12345-192.168.201.27@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790919247.206414:0:14433:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f601f44-7343-45ca-9d5e-f7bb6777e55d+11:13841:x1877914532555904:12345-192.168.201.27@tcp:501:mount.lustre.0 Request processed in 331us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919247.206422:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 92 00000100:00100000:2.0:1790919247.216365:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919247.216511:0:14432:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532556032 00000100:00100000:3.0:1790919247.216521:0:14432:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532556032 00000100:00100000:3.0:1790919247.216626:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 93 00000100:00100000:3.0:1790919247.216636:0:14432:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f601f44-7343-45ca-9d5e-f7bb6777e55d+11:13841:x1877914532556032:12345-192.168.201.27@tcp:503:mount.lustre.0 00000100:00100000:3.0:1790919247.219641:0:14432:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f601f44-7343-45ca-9d5e-f7bb6777e55d+11:13841:x1877914532556032:12345-192.168.201.27@tcp:503:mount.lustre.0 Request processed in 2996us (3277us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919247.219656:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 93 00000100:00100000:0.0:1790919247.239344:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919247.239577:0:14434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532556160 00000100:00100000:1.0:1790919247.239588:0:14434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532556160 00000100:00100000:1.0:1790919247.239642:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 94 00000100:00100000:1.0:1790919247.239652:0:14434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f601f44-7343-45ca-9d5e-f7bb6777e55d+11:13849:x1877914532556160:12345-192.168.201.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790919247.239971:0:14434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f601f44-7343-45ca-9d5e-f7bb6777e55d+11:13849:x1877914532556160:12345-192.168.201.27@tcp:502:llog_process_th.0 Request processed in 319us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919247.239989:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 94 00000100:00100000:0.0:1790919247.296184:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919247.296341:0:14432:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532556288 00000100:00100000:3.0:1790919247.296352:0:14432:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532556288 00000100:00100000:3.0:1790919247.296407:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 95 00000100:00100000:3.0:1790919247.296417:0:14432:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f601f44-7343-45ca-9d5e-f7bb6777e55d+11:13849:x1877914532556288:12345-192.168.201.27@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790919247.296938:0:14432:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f601f44-7343-45ca-9d5e-f7bb6777e55d+11:13849:x1877914532556288:12345-192.168.201.27@tcp:502:llog_process_th.0 Request processed in 520us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919247.296953:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 95 00000100:00100000:2.0:1790919247.305234:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919247.305573:0:14433:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532556416 00000100:00100000:3.0:1790919247.305583:0:14433:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532556416 00000100:00100000:3.0:1790919247.305633:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 96 00000100:00100000:3.0:1790919247.305643:0:14433:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be9f8d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f601f44-7343-45ca-9d5e-f7bb6777e55d+11:13841:x1877914532556416:12345-192.168.201.27@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790919247.305662:0:14433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919247.305682:0:14433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be813a2800/0xc3296956897c563a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8b413717672d011 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919247.305729:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be813a2800/0xc3296956897c563a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d011 expref: 12 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919247.305743:0:14433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be813a2800/0xc3296956897c563a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d011 expref: 12 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919247.305752:0:14433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be813a2800, rc 0) 00000100:00100000:3.0:1790919247.305823:0:14433:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be9f8d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f601f44-7343-45ca-9d5e-f7bb6777e55d+12:13841:x1877914532556416:12345-192.168.201.27@tcp:101:mount.lustre.0 Request processed in 181us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919247.305831:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 96 00000100:00100000:0.0:1790919247.309919:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919247.310028:0:14434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532556544 00000100:00100000:1.0:1790919247.310038:0:14434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532556544 00000100:00100000:1.0:1790919247.310108:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 97 00000100:00100000:1.0:1790919247.310129:0:14434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf69f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f601f44-7343-45ca-9d5e-f7bb6777e55d+12:13841:x1877914532556544:12345-192.168.201.27@tcp:256:mount.lustre.0 20000000:01000000:1.0:1790919247.310159:0:14434:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1790919247.310186:0:14434:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1790919247.310190:0:14434:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1790919247.310193:0:14434:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1790919247.310195:0:14434:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1790919247.323656:0:14434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf69f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f601f44-7343-45ca-9d5e-f7bb6777e55d+12:13841:x1877914532556544:12345-192.168.201.27@tcp:256:mount.lustre.0 Request processed in 13527us (13733us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919247.323671:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 97 00000100:00100000:2.0:1790919247.327632:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919247.327952:0:14432:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532556672 00000100:00100000:0.0:1790919247.327963:0:14432:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532556672 00000100:00100000:0.0:1790919247.328742:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 98 00000100:00100000:0.0:1790919247.328756:0:14432:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf69ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f601f44-7343-45ca-9d5e-f7bb6777e55d+12:13841:x1877914532556672:12345-192.168.201.27@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790919247.328773:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919247.328792:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88bebac59400/0xc3296956897c5641 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8b413717672d018 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919247.328821:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88bebac59400/0xc3296956897c5641 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d018 expref: 13 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919247.328850:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88bebac59400/0xc3296956897c5641 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d018 expref: 13 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919247.328872:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac59400, rc 0) 00000100:00100000:0.0:1790919247.328927:0:14432:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf69ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f601f44-7343-45ca-9d5e-f7bb6777e55d+13:13841:x1877914532556672:12345-192.168.201.27@tcp:101:mount.lustre.0 Request processed in 175us (1305us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919247.328935:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 98 00000100:00100000:2.0:1790919247.332776:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919247.333572:0:14434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532556800 00000100:00100000:0.0:1790919247.333584:0:14434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532556800 00000100:00100000:0.0:1790919247.333645:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 99 00000100:00100000:0.0:1790919247.333655:0:14434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf69e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f601f44-7343-45ca-9d5e-f7bb6777e55d+13:13841:x1877914532556800:12345-192.168.201.27@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790919247.333983:0:14434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf69e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f601f44-7343-45ca-9d5e-f7bb6777e55d+13:13841:x1877914532556800:12345-192.168.201.27@tcp:501:mount.lustre.0 Request processed in 328us (1216us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919247.333991:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 99 00000100:00100000:1.0:1790919247.336377:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919247.336489:0:14432:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532556928 00000100:00100000:0.0:1790919247.336498:0:14432:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532556928 00000100:00100000:0.0:1790919247.336576:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 100 00000100:00100000:0.0:1790919247.336586:0:14432:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf69c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f601f44-7343-45ca-9d5e-f7bb6777e55d+13:13841:x1877914532556928:12345-192.168.201.27@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790919247.337209:0:14432:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf69c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f601f44-7343-45ca-9d5e-f7bb6777e55d+13:13841:x1877914532556928:12345-192.168.201.27@tcp:503:mount.lustre.0 Request processed in 621us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919247.337217:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 100 00000100:00100000:2.0:1790919247.340877:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919247.340967:0:14433:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532557056 00000100:00100000:3.0:1790919247.340977:0:14433:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532557056 00000100:00100000:3.0:1790919247.341032:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 101 00000100:00100000:3.0:1790919247.341042:0:14433:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf69d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f601f44-7343-45ca-9d5e-f7bb6777e55d+13:13855:x1877914532557056:12345-192.168.201.27@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790919247.341385:0:14433:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf69d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f601f44-7343-45ca-9d5e-f7bb6777e55d+13:13855:x1877914532557056:12345-192.168.201.27@tcp:502:llog_process_th.0 Request processed in 343us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919247.341393:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 101 00000100:00100000:2.0:1790919247.349686:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919247.349826:0:14432:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532557184 00000100:00100000:0.0:1790919247.349837:0:14432:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532557184 00000100:00100000:0.0:1790919247.349903:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 102 00000100:00100000:0.0:1790919247.349913:0:14432:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf69f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f601f44-7343-45ca-9d5e-f7bb6777e55d+13:13855:x1877914532557184:12345-192.168.201.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790919247.350194:0:14432:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf69f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f601f44-7343-45ca-9d5e-f7bb6777e55d+13:13855:x1877914532557184:12345-192.168.201.27@tcp:502:llog_process_th.0 Request processed in 281us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919247.350203:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 102 00000100:00100000:1.0:1790919247.359615:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919247.360015:0:14440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532557312 00000100:00100000:2.0:1790919247.360026:0:14440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532557312 00000100:00100000:2.0:1790919247.360074:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 10 00000100:00100000:2.0:1790919247.360082:0:14440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2349:x1877914532557312:12345-192.168.201.27@tcp:38:mount.lustre.0 00010000:00080000:2.0:1790919247.360123:0:14440:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 971222de-c593-4f1b-9c93-71dc3d112472@192.168.201.27@tcp t0 exp 0000000000000000 cur 449 last 0 00000020:00000080:2.0:1790919247.360168:0:14440:0:(genops.c:1384:class_connect()) connect: client 971222de-c593-4f1b-9c93-71dc3d112472, cookie 0xc3296956897c5648 00000004:00100000:2.0:1790919247.360199:0:14440:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1790919247.360319:0:14440:0:(import.c:65:import_set_state_nolock()) ffff88bd8111a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790919247.360383:0:14440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:971222de-c593-4f1b-9c93-71dc3d112472+6:2349:x1877914532557312:12345-192.168.201.27@tcp:38:mount.lustre.0 Request processed in 299us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919247.360391:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 10 00000100:00100000:1.0:1790919247.380568:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919247.381062:0:14441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532557568 00000100:00100000:0.0:1790919247.381073:0:14441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532557568 00000100:00100000:0.0:1790919247.381161:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 11 00000100:00100000:0.0:1790919247.381171:0:14441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:971222de-c593-4f1b-9c93-71dc3d112472+6:13841:x1877914532557568:12345-192.168.201.27@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790919247.381215:0:14441:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790919247.381304:0:14441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:971222de-c593-4f1b-9c93-71dc3d112472+6:13841:x1877914532557568:12345-192.168.201.27@tcp:41:mount.lustre.0 Request processed in 133us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919247.381313:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 11 00000100:00100000:1.0:1790919247.384697:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919247.384778:0:14440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532557440 00000100:00100000:1.0:1790919247.384787:0:14440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532557440 00000100:00100000:1.0:1790919247.384842:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 12 00000100:00100000:1.0:1790919247.384850:0:14440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:971222de-c593-4f1b-9c93-71dc3d112472+6:0:x1877914532557440:12345-192.168.201.27@tcp:41:mount.lustre.0 00000004:00000024:1.0:1790919247.384892:0:14440:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1790919247.384956:0:14440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:971222de-c593-4f1b-9c93-71dc3d112472+6:0:x1877914532557440:12345-192.168.201.27@tcp:41:mount.lustre.0 Request processed in 106us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919247.384964:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 12 00000100:00080000:2.0:1790919247.387085:0:14435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790919247.402965:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919247.403261:0:14441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532557696 00000100:00100000:2.0:1790919247.403272:0:14441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532557696 00000100:00100000:2.0:1790919247.403338:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 13 00000100:00100000:2.0:1790919247.403348:0:14441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:971222de-c593-4f1b-9c93-71dc3d112472+6:13841:x1877914532557696:12345-192.168.201.27@tcp:40:mount.lustre.0 00000100:00100000:2.0:1790919247.403484:0:14441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:971222de-c593-4f1b-9c93-71dc3d112472+6:13841:x1877914532557696:12345-192.168.201.27@tcp:40:mount.lustre.0 Request processed in 136us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919247.403492:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 13 00000100:00100000:0.0:1790919247.414471:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919247.414509:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919247.414598:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919247.414676:0:15124:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532557824 00000100:00100000:1.0:1790919247.414686:0:15124:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532557824 00000100:00100000:1.0:1790919247.414729:0:15124:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532557952 00000100:00100000:1.0:1790919247.414732:0:15124:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532557952 00000100:00100000:1.0:1790919247.414746:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 11 00000100:00100000:1.0:1790919247.414772:0:15124:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2349:x1877914532557824:12345-192.168.201.27@tcp:8:mount.lustre.0 00010000:00080000:1.0:1790919247.414804:0:15124:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 971222de-c593-4f1b-9c93-71dc3d112472@192.168.201.27@tcp t0 exp 0000000000000000 cur 449 last 0 00000020:00000080:1.0:1790919247.414839:0:15124:0:(genops.c:1384:class_connect()) connect: client 971222de-c593-4f1b-9c93-71dc3d112472, cookie 0xc3296956897c564f 00002000:00100000:1.0:1790919247.414850:0:15124:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 971222de-c593-4f1b-9c93-71dc3d112472/ffff88be91610800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790919247.414873:0:15124:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790919247.415133:0:15124:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1790919247.415164:0:15124:0:(import.c:65:import_set_state_nolock()) ffff88be91617000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790919247.415510:0:15124:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:971222de-c593-4f1b-9c93-71dc3d112472+6:2349:x1877914532557824:12345-192.168.201.27@tcp:8:mount.lustre.0 Request processed in 735us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919247.415519:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 11 00000100:00100000:1.0:1790919247.415569:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 12 00000100:00100000:1.0:1790919247.415575:0:15124:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2349:x1877914532557952:12345-192.168.201.27@tcp:8:mount.lustre.0 00010000:00080000:1.0:1790919247.415592:0:15124:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 971222de-c593-4f1b-9c93-71dc3d112472@192.168.201.27@tcp t0 exp 0000000000000000 cur 449 last 0 00000020:00000080:1.0:1790919247.415613:0:15124:0:(genops.c:1384:class_connect()) connect: client 971222de-c593-4f1b-9c93-71dc3d112472, cookie 0xc3296956897c5656 00002000:00100000:1.0:1790919247.415619:0:15124:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 971222de-c593-4f1b-9c93-71dc3d112472/ffff88bebf874800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790919247.415627:0:15124:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790919247.415685:0:15124:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1790919247.415701:0:15124:0:(import.c:65:import_set_state_nolock()) ffff88bebf872800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790919247.415727:0:15124:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:971222de-c593-4f1b-9c93-71dc3d112472+6:2349:x1877914532557952:12345-192.168.201.27@tcp:8:mount.lustre.0 Request processed in 151us (1128us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919247.415734:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 12 00000100:00100000:3.0:1790919247.416613:0:14443:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532558080 00000100:00100000:3.0:1790919247.416622:0:14443:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532558080 00000100:00100000:3.0:1790919247.416669:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 1 00000100:00100000:3.0:1790919247.416677:0:14443:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:971222de-c593-4f1b-9c93-71dc3d112472+6:13841:x1877914532558080:12345-192.168.201.27@tcp:33:mount.lustre.0 00000004:00200000:3.0:1790919247.416747:0:14443:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1790919247.416815:0:14443:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:971222de-c593-4f1b-9c93-71dc3d112472+6:13841:x1877914532558080:12345-192.168.201.27@tcp:33:mount.lustre.0 Request processed in 139us (2352us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919247.416822:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 1 00000100:00100000:0.0:1790919247.591220:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919247.591401:0:14439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532558208 00000100:00100000:1.0:1790919247.591411:0:14439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532558208 00000100:00100000:1.0:1790919247.591474:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 14 00000100:00100000:1.0:1790919247.591499:0:14439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:971222de-c593-4f1b-9c93-71dc3d112472+6:13876:x1877914532558208:12345-192.168.201.27@tcp:101:mkdir.0 00010000:00010000:1.0:1790919247.591522:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919247.591586:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517200/0xc3296956897c565d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672d042 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919247.591640:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517e00/0xc3296956897c5664 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919247.591651:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517e00/0xc3296956897c5664 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919247.591662:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517e00/0xc3296956897c5664 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790919247.591689:0:14439:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790919247.591692:0:14439:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790919247.591707:0:14439:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517e00/0xc3296956897c5664 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919247.591725:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517200/0xc3296956897c565d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d042 expref: 8 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919247.591738:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517e00/0xc3296956897c5664 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d042 expref: 7 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919247.591743:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be8b621d00) 00010000:00010000:1.0:1790919247.591745:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790919247.591748:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81517e00, rc 0) 00000100:00100000:1.0:1790919247.591793:0:14439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:971222de-c593-4f1b-9c93-71dc3d112472+7:13876:x1877914532558208:12345-192.168.201.27@tcp:101:mkdir.0 Request processed in 298us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919247.591804:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 14 00010000:00010000:0.0:1790919247.743755:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919248.767666:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919249.664252:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb4267b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550375936:0@lo:400:kworker.0 00000100:00100000:3.0:1790919249.664337:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919249.664391:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1790919249.664397:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb4265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550375808:0@lo:400:kworker.0 00000100:00100000:3.0:1790919249.664419:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919249.664435:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb4265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1877914550376320:0@lo:400:kworker.0 00000100:00100000:3.0:1790919249.664459:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919249.664714:0:14441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550376320 00000100:00100000:2.0:1790919249.664722:0:14441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550376320 00000100:00100000:2.0:1790919249.664792:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790919249.664803:0:14441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877914550376320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919249.664861:0:14441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877914550376320:12345-0@lo:400:kworker.0 Request processed in 60us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919249.664868:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790919249.664924:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb4265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1877914550376320:0@lo:400:kworker.0 00000100:00100000:0.0:1790919249.665196:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb4267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:78fab146-b05d-43bc-9885-013f4b87a754:3308:1877914550375680:0@lo:400:kworker.0 00000100:00100000:0.0:1790919249.665234:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919249.665265:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb4264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1877914550376192:0@lo:400:kworker.0 00000100:00100000:0.0:1790919249.665303:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919249.665323:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790919249.665328:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb4265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877914550376064:0@lo:400:kworker.0 00000100:00100000:0.0:1790919249.665350:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919249.665376:0:15125:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550375936 00000100:00100000:0.0:1790919249.665394:0:15125:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550375936 00000100:00100000:0.0:1790919249.665422:0:15125:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550375808 00000100:00100000:0.0:1790919249.665425:0:15125:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550375808 00000100:00100000:0.0:1790919249.665441:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790919249.665448:0:15125:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550375936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919249.665486:0:15125:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550375936:12345-0@lo:400:kworker.0 Request processed in 39us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919249.665493:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790919249.665507:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790919249.665513:0:15125:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550375808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919249.665563:0:15125:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550375808:12345-0@lo:400:kworker.0 Request processed in 51us (1143us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919249.665569:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790919249.665822:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb4265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550375808:0@lo:400:kworker.0 00000100:00100000:2.0:1790919249.665832:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1790919249.665845:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb4267b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550375936:0@lo:400:kworker.0 00000100:00080000:3.0:1790919249.666125:0:14435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790919249.666130:0:14435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790919249.666133:0:14435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790919249.666145:0:15856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550376192 00000100:00100000:3.0:1790919249.666149:0:15856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550376192 00000100:00100000:3.0:1790919249.666199:0:15856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550376064 00000100:00100000:3.0:1790919249.666203:0:15856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550376064 00000100:00100000:3.0:1790919249.666222:0:15856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790919249.666230:0:15856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877914550376192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919249.666273:0:15856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877914550376192:12345-0@lo:400:kworker.0 Request processed in 45us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919249.666279:0:15856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790919249.666316:0:15856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790919249.666322:0:15856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877914550376064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919249.666353:0:15856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877914550376064:12345-0@lo:400:kworker.0 Request processed in 32us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919249.666359:0:15856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790919249.666412:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb4265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877914550376064:0@lo:400:kworker.0 00000100:00100000:3.0:1790919249.666423:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb4264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1877914550376192:0@lo:400:kworker.0 00000100:00100000:1.0:1790919249.666611:0:14434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550375680 00000100:00100000:1.0:1790919249.666616:0:14434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550375680 00000100:00100000:1.0:1790919249.666650:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790919249.666656:0:14434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf69d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+19:3308:x1877914550375680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919249.666693:0:14434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf69d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+19:3308:x1877914550375680:12345-0@lo:400:kworker.0 Request processed in 37us (1458us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919249.666699:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790919249.666780:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790919249.666791:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550376448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790919249.666817:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919249.666844:0:15126:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550376448 00000100:00100000:1.0:1790919249.666848:0:15126:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550376448 00000100:00100000:1.0:1790919249.666883:0:15126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790919249.666890:0:15126:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550376448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790919249.666919:0:15126:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919249.666954:0:15126:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550376448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919249.666961:0:15126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790919249.666994:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550376448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790919249.667022:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb4267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:78fab146-b05d-43bc-9885-013f4b87a754:3308:1877914550375680:0@lo:400:kworker.0 00000100:00080000:2.0:1790919249.667323:0:14435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:2.0:1790919249.714272:0:5869:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a397f618-6104-4fd0-addb-afcbd50d641f 00000001:00100000:2.0:1790919249.714292:0:5869:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 971222de-c593-4f1b-9c93-71dc3d112472 00000001:00100000:2.0:1790919249.715785:0:7662:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 971222de-c593-4f1b-9c93-71dc3d112472 00000001:00100000:2.0:1790919249.715803:0:7662:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a397f618-6104-4fd0-addb-afcbd50d641f 00010000:00010000:0.0:1790919249.791903:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790919250.740403:0:16407:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1790919250.818235:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919251.840340:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919252.233850:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790919252.233875:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb4264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550376576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790919252.233944:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919252.234755:0:15126:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550376576 00000100:00100000:3.0:1790919252.234767:0:15126:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550376576 00000100:00100000:3.0:1790919252.234835:0:15126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790919252.234846:0:15126:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550376576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790919252.234888:0:15126:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919252.234949:0:15126:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550376576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919252.234956:0:15126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1790919252.234977:0:14435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790919252.235017:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb4264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550376576:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1790919252.312100:0:6722:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 971222de-c593-4f1b-9c93-71dc3d112472 00000100:00100000:3.0:1790919252.688582:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919252.688617:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919252.688648:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919252.688678:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919252.688697:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919252.688712:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919252.688739:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919252.688761:0:14433:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532558336 00000100:00100000:3.0:1790919252.688782:0:14433:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532558336 00000100:00100000:3.0:1790919252.688826:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 104 00000100:00100000:3.0:1790919252.688835:0:14433:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf69e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f601f44-7343-45ca-9d5e-f7bb6777e55d+13:2351:x1877914532558336:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1790919252.688919:0:14433:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf69e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f601f44-7343-45ca-9d5e-f7bb6777e55d+13:2351:x1877914532558336:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 84us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919252.688927:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 104 00000100:00100000:3.0:1790919252.688959:0:14440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532558464 00000100:00100000:3.0:1790919252.688963:0:14440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532558464 00000100:00100000:3.0:1790919252.689012:0:14440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532558848 00000100:00100000:3.0:1790919252.689016:0:14440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532558848 00000100:00100000:3.0:1790919252.689057:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 19 00000100:00100000:3.0:1790919252.689064:0:14440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a397f618-6104-4fd0-addb-afcbd50d641f+6:2351:x1877914532558464:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1790919252.689096:0:14440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a397f618-6104-4fd0-addb-afcbd50d641f+6:2351:x1877914532558464:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 33us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919252.689103:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 19 00000100:00100000:3.0:1790919252.689115:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 20 00000100:00100000:3.0:1790919252.689120:0:14440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:971222de-c593-4f1b-9c93-71dc3d112472+6:2351:x1877914532558848:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1790919252.689143:0:14440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:971222de-c593-4f1b-9c93-71dc3d112472+6:2351:x1877914532558848:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 22us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919252.689149:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 20 00000100:00080000:3.0:1790919252.689266:0:14435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790919252.689522:0:15125:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532558720 00000100:00100000:1.0:1790919252.689567:0:15125:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532558720 00000100:00100000:1.0:1790919252.689603:0:15125:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532558976 00000100:00100000:1.0:1790919252.689606:0:15125:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532558976 00000100:00100000:1.0:1790919252.689619:0:15125:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532558592 00000100:00100000:1.0:1790919252.689622:0:15125:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532558592 00000100:00100000:1.0:1790919252.689633:0:15125:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532559104 00000100:00100000:1.0:1790919252.689636:0:15125:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532559104 00000100:00100000:1.0:1790919252.689650:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 6 00000100:00100000:1.0:1790919252.689657:0:15125:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4265c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a397f618-6104-4fd0-addb-afcbd50d641f+5:2351:x1877914532558720:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:1.0:1790919252.689693:0:15125:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4265c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a397f618-6104-4fd0-addb-afcbd50d641f+5:2351:x1877914532558720:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 37us (1074us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919252.689700:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 6 00000100:00100000:1.0:1790919252.689714:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 7 00000100:00100000:1.0:1790919252.689720:0:15125:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:971222de-c593-4f1b-9c93-71dc3d112472+5:2351:x1877914532558976:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:1.0:1790919252.689743:0:15125:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:971222de-c593-4f1b-9c93-71dc3d112472+5:2351:x1877914532558976:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 24us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919252.689749:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 7 00000100:00100000:1.0:1790919252.689762:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 8 00000100:00100000:1.0:1790919252.689768:0:15125:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a397f618-6104-4fd0-addb-afcbd50d641f+5:2351:x1877914532558592:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:1.0:1790919252.689791:0:15125:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a397f618-6104-4fd0-addb-afcbd50d641f+5:2351:x1877914532558592:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 24us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919252.689798:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 8 00000100:00100000:1.0:1790919252.689809:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 9 00000100:00100000:1.0:1790919252.689815:0:15125:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:971222de-c593-4f1b-9c93-71dc3d112472+5:2351:x1877914532559104:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:1.0:1790919252.689836:0:15125:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:971222de-c593-4f1b-9c93-71dc3d112472+5:2351:x1877914532559104:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 21us (1103us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919252.689849:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 9 00000100:00080000:3.0:1790919252.689986:0:14435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790919252.689989:0:14435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1790919252.867582:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790919253.121653:0:14472:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790919253.887682:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790919254.099981:0:16557:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc0ed0a700 20000000:00000080:2.0:1790919254.100905:0:16557:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff88bead4e3000 uarg=0000000000000000 20000000:01000000:2.0:1790919254.100948:0:16557:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790919254.100954:0:16557:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790919254.100959:0:16557:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1790919254.101779:0:16558:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1790919254.101970:0:16557:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1790919254.110351:0:16557:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790919254.116346:0:16557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88be813a2c00/0xc3296956897c566b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919254.116390:0:16557:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88be90f9f800/0xc3296956897c5362 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c535b expref: 18 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919254.116398:0:16557:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88beb3f7ec00/0xc3296956897c53af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c53a8 expref: 18 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919254.116404:0:16557:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88be81516600/0xc3296956897c54e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c54dc expref: 18 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919254.116412:0:16557:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88be81517000/0xc3296956897c5609 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cfb6 expref: 12 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919254.116418:0:16557:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88bebac59400/0xc3296956897c5641 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d018 expref: 12 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919254.116426:0:16557:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88be813a2c00/0xc3296956897c566b lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919254.116467:0:16557:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88bebac59400/0xc3296956897c5641 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672d018 expref: 12 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919254.116482:0:16557:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88bebac59400/0xc3296956897c5641 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672d018 expref: 12 pid: 14432 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919254.116494:0:16557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb4267b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16557:1877914550376704:192.168.201.27@tcp:104: 00010000:00010000:3.0:1790919254.116950:0:16557:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88be81517000/0xc3296956897c5609 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cfb6 expref: 12 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919254.116958:0:16557:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88be81517000/0xc3296956897c5609 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cfb6 expref: 12 pid: 14434 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919254.116972:0:16557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb4265180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16557:1877914550376832:192.168.201.27@tcp:104: 00010000:00010000:3.0:1790919254.117019:0:16557:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88be81516600/0xc3296956897c54e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3296956897c54dc expref: 18 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919254.117026:0:16557:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88be81516600/0xc3296956897c54e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3296956897c54dc expref: 18 pid: 14433 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919254.117035:0:16557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb4265880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16557:1877914550376960:0@lo:104: 00000100:00100000:3.0:1790919254.117074:0:16557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790919254.117153:0:16557:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88beb3f7ec00/0xc3296956897c53af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3296956897c53a8 expref: 18 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919254.117162:0:16557:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88beb3f7ec00/0xc3296956897c53af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3296956897c53a8 expref: 18 pid: 14432 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919254.117169:0:16557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf78aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16557:1877914550377088:0@lo:104: 00000100:00100000:3.0:1790919254.117189:0:16557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790919254.120761:0:16557:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88be90f9f800/0xc3296956897c5362 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3296956897c535b expref: 18 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919254.120777:0:16557:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88be90f9f800/0xc3296956897c5362 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3296956897c535b expref: 18 pid: 14433 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919254.120791:0:16557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf789500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16557:1877914550377216:0@lo:104: 00000100:00100000:3.0:1790919254.120844:0:16557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919254.120952:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919254.121033:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919254.121600:0:14426:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532559232 00000100:00100000:1.0:1790919254.121610:0:14426:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532559232 00010000:00010000:1.0:1790919254.121645:0:14426:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88bebac59400/0xc3296956897c5641 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672d018 expref: 13 pid: 14432 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919254.121672:0:14426:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532559360 00000100:00100000:1.0:1790919254.121675:0:14426:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532559360 00010000:00010000:1.0:1790919254.121685:0:14426:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88be81517000/0xc3296956897c5609 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cfb6 expref: 14 pid: 14434 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919254.121700:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 4 00000100:00100000:1.0:1790919254.121709:0:14426:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f601f44-7343-45ca-9d5e-f7bb6777e55d+14:2352:x1877914532559232:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790919254.121721:0:14426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919254.121726:0:14426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88bebac59400/0xc3296956897c5641 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672d018 expref: 14 pid: 14432 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919254.121738:0:14426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88bebac59400/0xc3296956897c5641 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672d018 expref: 14 pid: 14432 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919254.121767:0:14426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919254.121812:0:14426:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f601f44-7343-45ca-9d5e-f7bb6777e55d+14:2352:x1877914532559232:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 104us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919254.121819:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 4 00000100:00100000:1.0:1790919254.121838:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 5 00000100:00100000:1.0:1790919254.121859:0:14426:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f601f44-7343-45ca-9d5e-f7bb6777e55d+13:2352:x1877914532559360:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790919254.121866:0:14426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919254.121870:0:14426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88be81517000/0xc3296956897c5609 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cfb6 expref: 13 pid: 14434 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919254.121878:0:14426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88be81517000/0xc3296956897c5609 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cfb6 expref: 13 pid: 14434 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919254.121888:0:14426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919254.121907:0:14426:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f601f44-7343-45ca-9d5e-f7bb6777e55d+13:2352:x1877914532559360:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 50us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919254.121913:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 5 00000100:00100000:0.0:1790919254.122410:0:14423:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550376960 00000100:00100000:0.0:1790919254.122415:0:14423:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550376960 00000100:00100000:0.0:1790919254.122444:0:14423:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550377088 00000100:00100000:0.0:1790919254.122447:0:14423:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550377088 00000100:00100000:0.0:1790919254.122458:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790919254.122464:0:14423:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4265500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:78fab146-b05d-43bc-9885-013f4b87a754+4:16557:x1877914550376960:12345-0@lo:104: 00010000:00010000:0.0:1790919254.122477:0:14423:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.127@tcp lock: ffff88be90f9f200/0xc3296956897c54dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c54e3 expref: -99 pid: 15844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919254.122559:0:14423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790919254.122564:0:14423:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4265500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:78fab146-b05d-43bc-9885-013f4b87a754+4:16557:x1877914550376960:12345-0@lo:104: Request processed in 101us (5491us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919254.122570:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790919254.122594:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790919254.122599:0:14423:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf78b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:78fab146-b05d-43bc-9885-013f4b87a754+3:16557:x1877914550377088:12345-0@lo:104: 00010000:00010000:0.0:1790919254.122607:0:14423:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.127@tcp lock: ffff88bebac58400/0xc3296956897c53a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c53af expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919254.122646:0:14423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790919254.122652:0:14423:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf78b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:78fab146-b05d-43bc-9885-013f4b87a754+3:16557:x1877914550377088:12345-0@lo:104: Request processed in 53us (5462us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919254.122658:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1790919254.123575:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790919254.123584:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff88be90f9f200/0xc3296956897c54dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c54e3 expref: -99 pid: 15844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919254.123591:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be90f9f200 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:0.0:1790919254.123595:0:14429:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff88be90f9f200/0xc3296956897c54dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3296956897c54e3 expref: -99 pid: 15844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919254.123603:0:14429:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff88be90f9f200/0xc3296956897c54dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3296956897c54e3 expref: -99 pid: 15844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790919254.123609:0:14429:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff88be90f9f200/0xc3296956897c54dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3296956897c54e3 expref: -99 pid: 15844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919254.123613:0:14429:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790919254.123649:0:14429:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff88be90f9f200/0xc3296956897c54dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c54e3 expref: -99 pid: 15844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919254.123654:0:14429:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790919254.123676:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff88be90f9f200/0xc3296956897c54dc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c54e3 expref: -99 pid: 15844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919254.123693:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff88be90f9f200/0xc3296956897c54dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c54e3 expref: -99 pid: 15844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919254.123703:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919254.123706:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff88bebac58400/0xc3296956897c53a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c53af expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919254.123710:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac58400 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:0.0:1790919254.123713:0:14429:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff88bebac58400/0xc3296956897c53a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3296956897c53af expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919254.123719:0:14429:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff88bebac58400/0xc3296956897c53a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3296956897c53af expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790919254.123724:0:14429:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff88bebac58400/0xc3296956897c53a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3296956897c53af expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919254.123728:0:14429:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790919254.123739:0:14429:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff88bebac58400/0xc3296956897c53a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c53af expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919254.124407:0:14429:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1790919254.124463:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:78fab146-b05d-43bc-9885-013f4b87a754:3305:1877914550377472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790919254.124546:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790919254.124669:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff88bebac58400/0xc3296956897c53a8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c53af expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919254.124678:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff88bebac58400/0xc3296956897c53a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c53af expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919254.124688:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919254.124698:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919254.124700:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919254.124708:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919254.124718:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:78fab146-b05d-43bc-9885-013f4b87a754:3308:1877914550377344:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790919254.124759:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919254.124802:0:14427:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550377472 00000100:00100000:0.0:1790919254.124808:0:14427:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550377472 00010000:00010000:0.0:1790919254.124832:0:14427:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88beb3f7ec00/0xc3296956897c53af lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c53a8 expref: 19 pid: 14432 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919254.124849:0:14427:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550377344 00000100:00100000:0.0:1790919254.124851:0:14427:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550377344 00010000:00010000:0.0:1790919254.124859:0:14427:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88be81516600/0xc3296956897c54e3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c54dc expref: 20 pid: 14433 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919254.124869:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790919254.124875:0:14427:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88de9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78fab146-b05d-43bc-9885-013f4b87a754+20:3305:x1877914550377472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790919254.124886:0:14427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919254.124890:0:14427:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88beb3f7ec00/0xc3296956897c53af lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c53a8 expref: 20 pid: 14432 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919254.124900:0:14427:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88beb3f7ec00/0xc3296956897c53af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3296956897c53a8 expref: 20 pid: 14432 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919254.124914:0:14427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919254.125020:0:16557:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be8652e540 going to sleep for 11 seconds 00010000:00010000:3.0:1790919254.125045:0:16557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88bebac59400/0xc3296956897c5641 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672d018 expref: 12 pid: 14432 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919254.125067:0:16557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb4267b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16557:1877914550376704:192.168.201.27@tcp:104: 00010000:00010000:3.0:1790919254.125081:0:16557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be81517000/0xc3296956897c5609 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672cfb6 expref: 11 pid: 14434 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919254.125088:0:16557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb4265180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16557:1877914550376832:192.168.201.27@tcp:104: 00000100:00100000:3.0:1790919254.125095:0:16557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb4265880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16557:1877914550376960:0@lo:104: 00010000:00010000:3.0:1790919254.125102:0:16557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88beb3f7ec00/0xc3296956897c53af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3296956897c53a8 expref: 20 pid: 14432 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919254.125121:0:16557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf78aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16557:1877914550377088:0@lo:104: 00000100:00100000:2.0:1790919254.125419:0:14424:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550377216 00000100:00100000:2.0:1790919254.125425:0:14424:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550377216 00000100:00100000:2.0:1790919254.125457:0:14424:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1790919254.125470:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790919254.125477:0:14424:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebacc4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:78fab146-b05d-43bc-9885-013f4b87a754+3:16557:x1877914550377216:12345-0@lo:104: 00010000:00010000:2.0:1790919254.125487:0:14424:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.127@tcp lock: ffff88beb3f7e200/0xc3296956897c535b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c5362 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919254.125553:0:14424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790919254.125558:0:14424:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebacc4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:78fab146-b05d-43bc-9885-013f4b87a754+3:16557:x1877914550377216:12345-0@lo:104: Request processed in 82us (4714us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919254.125564:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790919254.125601:0:14425:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1790919254.125606:0:14425:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1790919254.129423:0:16557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf789500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16557:1877914550377216:0@lo:104: 00010000:00010000:3.0:1790919254.129467:0:16557:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88be813a2c00/0xc3296956897c566b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919254.131326:0:14427:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88de9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78fab146-b05d-43bc-9885-013f4b87a754+19:3305:x1877914550377472:12345-0@lo:103:ldlm_bl.0 Request processed in 6442us (6792us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919254.131339:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790919254.131429:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790919254.131440:0:14427:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78fab146-b05d-43bc-9885-013f4b87a754+18:3308:x1877914550377344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790919254.131467:0:14427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919254.131475:0:14427:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88be81516600/0xc3296956897c54e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c54dc expref: 18 pid: 14433 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919254.131490:0:14427:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88be81516600/0xc3296956897c54e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3296956897c54dc expref: 18 pid: 14433 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919254.131507:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be81516600/0xc3296956897c54e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3296956897c54dc expref: 18 pid: 14433 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919254.131522:0:14427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919254.131695:0:14427:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78fab146-b05d-43bc-9885-013f4b87a754+17:3308:x1877914550377344:12345-0@lo:103:ldlm_bl.0 Request processed in 258us (6934us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919254.131702:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1790919254.131728:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919254.131735:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff88beb3f7e200/0xc3296956897c535b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3296956897c5362 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919254.131755:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88beb3f7e200 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:0.0:1790919254.131759:0:14429:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff88beb3f7e200/0xc3296956897c535b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3296956897c5362 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919254.131767:0:14429:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff88beb3f7e200/0xc3296956897c535b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3296956897c5362 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790919254.131773:0:14429:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff88beb3f7e200/0xc3296956897c535b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3296956897c5362 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919254.131778:0:14429:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790919254.131813:0:14429:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff88beb3f7e200/0xc3296956897c535b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c5362 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919254.131826:0:14429:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790919254.131845:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff88beb3f7e200/0xc3296956897c535b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c5362 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919254.131850:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff88beb3f7e200/0xc3296956897c535b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3296956897c5362 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919254.131865:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919254.131867:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919254.131868:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919254.131882:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:78fab146-b05d-43bc-9885-013f4b87a754:3306:1877914550377600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790919254.131916:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919254.131950:0:14427:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550377600 00000100:00100000:0.0:1790919254.131957:0:14427:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550377600 00010000:00010000:0.0:1790919254.131975:0:14427:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88be90f9f800/0xc3296956897c5362 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c535b expref: 17 pid: 14433 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919254.131991:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790919254.132008:0:14427:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78fab146-b05d-43bc-9885-013f4b87a754+17:3306:x1877914550377600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790919254.132017:0:14427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919254.132021:0:14427:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88be90f9f800/0xc3296956897c5362 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3296956897c535b expref: 17 pid: 14433 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919254.132030:0:14427:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88be90f9f800/0xc3296956897c5362 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3296956897c535b expref: 17 pid: 14433 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919254.132041:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be90f9f800/0xc3296956897c5362 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3296956897c535b expref: 17 pid: 14433 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919254.132064:0:14427:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88be813a2c00/0xc3296956897c566b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919254.132073:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be813a2c00/0xc3296956897c566b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919254.132087:0:14427:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88be813a2c00/0xc3296956897c566b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919254.132094:0:14427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88be813a2c00/0xc3296956897c566b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919254.132101:0:14427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88be813a2c00/0xc3296956897c566b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919254.132107:0:14427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88be813a2c00/0xc3296956897c566b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919254.133856:0:14427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be813a2c00 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:0.0:1790919254.133863:0:14427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88be813a2c00/0xc3296956897c566b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919254.133873:0:14427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88be813a2c00/0xc3296956897c566b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919254.133895:0:14427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88be813a2c00/0xc3296956897c566b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919254.133909:0:14427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919254.133972:0:14427:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78fab146-b05d-43bc-9885-013f4b87a754+16:3306:x1877914550377600:12345-0@lo:103:ldlm_bl.0 Request processed in 1973us (2053us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919254.133991:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790919254.134068:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:78fab146-b05d-43bc-9885-013f4b87a754:3306:1877914550377600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790919254.134171:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:78fab146-b05d-43bc-9885-013f4b87a754:3305:1877914550377472:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790919254.134846:0:16557:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88be813a2c00/0xc3296956897c566b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919254.134857:0:16557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88be813a2c00/0xc3296956897c566b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919254.134864:0:16557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88be813a2c00/0xc3296956897c566b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919254.145144:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:78fab146-b05d-43bc-9885-013f4b87a754:3308:1877914550377344:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790919254.784152:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550377728:0@lo:400:kworker.0 00000100:00100000:0.0:1790919254.784288:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919254.784466:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550377856:0@lo:400:kworker.0 00000100:00100000:3.0:1790919254.784498:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919254.785451:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790919254.785473:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1877914550378240:0@lo:400:kworker.0 00000100:00100000:3.0:1790919254.785512:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919254.785584:0:14440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550378240 00000100:00100000:3.0:1790919254.785591:0:14440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550378240 00000100:00100000:3.0:1790919254.785793:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790919254.785807:0:14440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf78aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877914550378240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919254.785880:0:14440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf78aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877914550378240:12345-0@lo:400:kworker.0 Request processed in 77us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919254.785888:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1790919254.785910:0:14435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790919254.786142:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1877914550378240:0@lo:400:kworker.0 00000100:00100000:0.0:1790919254.786891:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1877914550378112:0@lo:400:kworker.0 00000100:00100000:0.0:1790919254.786954:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919254.787006:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790919254.787012:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877914550377984:0@lo:400:kworker.0 00000100:00100000:0.0:1790919254.787037:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919254.787136:0:15856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550378112 00000100:00100000:0.0:1790919254.787141:0:15856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550378112 00000100:00100000:0.0:1790919254.787175:0:15856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550377984 00000100:00100000:0.0:1790919254.787179:0:15856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550377984 00000100:00100000:0.0:1790919254.787193:0:15856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790919254.787212:0:15856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877914550378112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919254.787255:0:15856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877914550378112:12345-0@lo:400:kworker.0 Request processed in 44us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919254.787262:0:15856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790919254.787279:0:15856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790919254.787284:0:15856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877914550377984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919254.787313:0:15856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877914550377984:12345-0@lo:400:kworker.0 Request processed in 28us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919254.787319:0:15856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790919254.787349:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877914550377984:0@lo:400:kworker.0 00000100:00100000:0.0:1790919254.787359:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1877914550378112:0@lo:400:kworker.0 00000100:00100000:0.0:1790919254.787721:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790919254.787729:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb0b1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550378368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790919254.787763:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790919254.788130:0:14435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790919254.788149:0:15126:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550378368 00000100:00100000:3.0:1790919254.788154:0:15126:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550378368 00000100:00100000:3.0:1790919254.788189:0:15126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790919254.788195:0:15126:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550378368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790919254.788239:0:15126:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919254.788282:0:15126:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550378368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919254.788289:0:15126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1790919254.788319:0:14435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790919254.789046:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb0b1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550378368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790919254.789187:0:15125:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550377728 00000100:00100000:1.0:1790919254.789194:0:15125:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550377728 00000100:00100000:1.0:1790919254.789323:0:15122:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550377856 00000100:00100000:1.0:1790919254.789327:0:15122:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550377856 00000100:00100000:1.0:1790919254.789344:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790919254.789352:0:15122:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550377728:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1790919254.789510:0:14435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790919254.789576:0:15122:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550377728:12345-0@lo:400:kworker.0 Request processed in 224us (5288us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919254.789584:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790919254.789600:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790919254.789607:0:15122:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf789500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550377856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919254.789741:0:15122:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf789500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1877914550377856:12345-0@lo:400:kworker.0 Request processed in 134us (5241us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919254.789748:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790919254.789763:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1877914550377856:0@lo:400:kworker.0 00000100:00100000:1.0:1790919254.789775:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550377728:0@lo:400:kworker.0 00010000:00010000:3.0:1790919254.921398:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919255.440582:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919255.440689:0:14432:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532559488 00000100:00100000:0.0:1790919255.440701:0:14432:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532559488 00000100:00100000:0.0:1790919255.440766:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 105 00000100:00100000:0.0:1790919255.440776:0:14432:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf69cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f601f44-7343-45ca-9d5e-f7bb6777e55d+11:13728:x1877914532559488:12345-192.168.201.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790919255.440797:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919255.440819:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88bebac59000/0xc3296956897c5672 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8b413717672d049 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919255.440849:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88bebac59000/0xc3296956897c5672 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d049 expref: 12 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919255.440859:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88bebac59000/0xc3296956897c5672 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d049 expref: 12 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919255.440868:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac59000, rc 0) 00000100:00100000:0.0:1790919255.440922:0:14432:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf69cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f601f44-7343-45ca-9d5e-f7bb6777e55d+12:13728:x1877914532559488:12345-192.168.201.27@tcp:101:ll_cfg_requeue.0 Request processed in 146us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919255.440930:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 105 00000100:00100000:2.0:1790919255.467815:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919255.467853:0:14434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532559616 00000100:00100000:2.0:1790919255.467863:0:14434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532559616 00000100:00100000:2.0:1790919255.468709:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 106 00000100:00100000:2.0:1790919255.468851:0:14434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf69d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f601f44-7343-45ca-9d5e-f7bb6777e55d+12:13728:x1877914532559616:12345-192.168.201.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790919255.471394:0:14434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf69d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f601f44-7343-45ca-9d5e-f7bb6777e55d+12:13728:x1877914532559616:12345-192.168.201.27@tcp:501:ll_cfg_requeue.0 Request processed in 2660us (3572us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919255.471409:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 106 00000100:00100000:0.0:1790919255.504263:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919255.504333:0:14433:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532559744 00000100:00100000:3.0:1790919255.504345:0:14433:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532559744 00000100:00100000:3.0:1790919255.504399:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 107 00000100:00100000:3.0:1790919255.504419:0:14433:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf69c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f601f44-7343-45ca-9d5e-f7bb6777e55d+12:13728:x1877914532559744:12345-192.168.201.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790919255.504743:0:14433:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf69c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f601f44-7343-45ca-9d5e-f7bb6777e55d+12:13728:x1877914532559744:12345-192.168.201.27@tcp:503:ll_cfg_requeue.0 Request processed in 325us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919255.504753:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 107 00000100:00100000:0.0:1790919255.523597:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919255.523630:0:14434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532559872 00000100:00100000:1.0:1790919255.523640:0:14434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532559872 00000100:00100000:1.0:1790919255.523699:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 108 00000100:00100000:1.0:1790919255.523710:0:14434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf69fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f601f44-7343-45ca-9d5e-f7bb6777e55d+12:13728:x1877914532559872:12345-192.168.201.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790919255.523728:0:14434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919255.523750:0:14434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be81516400/0xc3296956897c5679 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8b413717672d050 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919255.523786:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be81516400/0xc3296956897c5679 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d050 expref: 13 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919255.523797:0:14434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be81516400/0xc3296956897c5679 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d050 expref: 13 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919255.523807:0:14434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81516400, rc 0) 00000100:00100000:1.0:1790919255.523868:0:14434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf69fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f601f44-7343-45ca-9d5e-f7bb6777e55d+13:13728:x1877914532559872:12345-192.168.201.27@tcp:101:ll_cfg_requeue.0 Request processed in 159us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919255.523876:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 108 00000100:00100000:2.0:1790919255.553234:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919255.553485:0:14433:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532560000 00000100:00100000:3.0:1790919255.553497:0:14433:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532560000 00000100:00100000:1.0:1790919255.553919:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 109 00000100:00100000:1.0:1790919255.553931:0:14433:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf69f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f601f44-7343-45ca-9d5e-f7bb6777e55d+13:13728:x1877914532560000:12345-192.168.201.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790919255.554287:0:14433:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf69f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f601f44-7343-45ca-9d5e-f7bb6777e55d+13:13728:x1877914532560000:12345-192.168.201.27@tcp:501:ll_cfg_requeue.0 Request processed in 357us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919255.554308:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 109 00000100:00100000:1.0:1790919255.557919:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919255.558070:0:14432:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532560128 00000100:00100000:3.0:1790919255.558082:0:14432:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532560128 00000100:00100000:3.0:1790919255.558146:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 110 00000100:00100000:3.0:1790919255.558158:0:14432:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf69e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f601f44-7343-45ca-9d5e-f7bb6777e55d+13:13728:x1877914532560128:12345-192.168.201.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790919255.558386:0:14432:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf69e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f601f44-7343-45ca-9d5e-f7bb6777e55d+13:13728:x1877914532560128:12345-192.168.201.27@tcp:503:ll_cfg_requeue.0 Request processed in 228us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919255.558394:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 110 00010000:00010000:0.0:1790919255.936746:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790919256.068355:0:14436:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790919256.068372:0:14436:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88bebf872000 from 10 10000000:01000000:2.0:1790919256.068378:0:14436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790919256.068420:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be88387e00/0xc3296956897c5680 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919256.068432:0:14436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88be88387e00/0xc3296956897c5680 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919256.068443:0:14436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88be88387e00/0xc3296956897c5680 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919256.068480:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf74f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:78fab146-b05d-43bc-9885-013f4b87a754:14436:1877914550378496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790919256.068565:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919256.068618:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bd8112d900 going to sleep for 11 seconds 00000100:00100000:3.0:1790919256.068631:0:14434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550378496 00000100:00100000:3.0:1790919256.068641:0:14434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550378496 00000100:00100000:3.0:1790919256.068736:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790919256.068746:0:14434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf69dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+16:14436:x1877914550378496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790919256.068761:0:14434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919256.068775:0:14434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be813a2c00/0xc3296956897c5687 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c5680 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919256.068801:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be813a2c00/0xc3296956897c5687 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c5680 expref: 17 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919256.068811:0:14434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be813a2c00/0xc3296956897c5687 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c5680 expref: 17 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919256.068831:0:14434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be813a2c00, rc 0) 00000100:00100000:3.0:1790919256.068873:0:14434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf69dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78fab146-b05d-43bc-9885-013f4b87a754+17:14436:x1877914550378496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919256.068880:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790919256.072293:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf74f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:78fab146-b05d-43bc-9885-013f4b87a754:14436:1877914550378496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790919256.072324:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88be88387e00/0xc3296956897c5680 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c5687 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919256.072337:0:14436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88be88387e00/0xc3296956897c5680 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c5687 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919256.072420:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf78b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:78fab146-b05d-43bc-9885-013f4b87a754:14436:1877914550378624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790919256.072480:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919256.072692:0:14432:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550378624 00000100:00100000:0.0:1790919256.072699:0:14432:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550378624 00000100:00100000:3.0:1790919256.072886:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be8652ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919256.073121:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1790919256.073132:0:14432:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf69c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78fab146-b05d-43bc-9885-013f4b87a754+17:14436:x1877914550378624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790919256.076387:0:14432:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf69c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78fab146-b05d-43bc-9885-013f4b87a754+17:14436:x1877914550378624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3247us (3896us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919256.076402:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1790919256.076580:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf78b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:78fab146-b05d-43bc-9885-013f4b87a754:14436:1877914550378624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790919256.076641:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:78fab146-b05d-43bc-9885-013f4b87a754:14436:1877914550378752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790919256.076711:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919256.081574:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bd82c4e600 going to sleep for 11 seconds 00000100:00100000:2.0:1790919256.081695:0:14433:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550378752 00000100:00100000:2.0:1790919256.081705:0:14433:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550378752 00000100:00100000:2.0:1790919256.081757:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1790919256.081766:0:14433:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+17:14436:x1877914550378752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790919256.082031:0:14433:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+17:14436:x1877914550378752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 257us (5310us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919256.082039:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1790919256.085167:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:78fab146-b05d-43bc-9885-013f4b87a754:14436:1877914550378752:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790919256.085853:0:16633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1790919256.085907:0:14436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1790919256.085928:0:14436:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790919256.085939:0:14436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be88387e00/0xc3296956897c5680 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c5687 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919256.085950:0:14436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88be88387e00/0xc3296956897c5680 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c5687 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919256.085959:0:14436:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790919256.085971:0:14436:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88bebf7d4800 from 10 10000000:01000000:1.0:1790919256.085975:0:14436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790919256.086006:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be81517600/0xc3296956897c568e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919256.086013:0:14436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88be81517600/0xc3296956897c568e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919256.086023:0:14436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88be81517600/0xc3296956897c568e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919256.086055:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:78fab146-b05d-43bc-9885-013f4b87a754:14436:1877914550378880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790919256.086115:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919256.086152:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bd82c4e000 going to sleep for 11 seconds 00000100:00100000:1.0:1790919256.086171:0:14433:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550378880 00000100:00100000:1.0:1790919256.086177:0:14433:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550378880 00000100:00100000:1.0:1790919256.086211:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1790919256.086219:0:14433:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba116850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+17:14436:x1877914550378880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790919256.086233:0:14433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919256.086247:0:14433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be81517a00/0xc3296956897c5695 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c568e expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919256.086269:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be81517a00/0xc3296956897c5695 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c568e expref: 18 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919256.086279:0:14433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be81517a00/0xc3296956897c5695 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c568e expref: 18 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919256.086287:0:14433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81517a00, rc 0) 00000100:00100000:1.0:1790919256.086322:0:14433:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba116850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+18:14436:x1877914550378880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919256.086329:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1790919256.086368:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:78fab146-b05d-43bc-9885-013f4b87a754:14436:1877914550378880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790919256.086381:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88be81517600/0xc3296956897c568e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c5695 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919256.086389:0:14436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88be81517600/0xc3296956897c568e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c5695 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919256.086439:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:78fab146-b05d-43bc-9885-013f4b87a754:14436:1877914550379008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790919256.086464:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919256.086477:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bd82c4e000 going to sleep for 11 seconds 00000100:00100000:1.0:1790919256.086487:0:14433:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550379008 00000100:00100000:1.0:1790919256.086490:0:14433:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550379008 00000100:00100000:1.0:1790919256.086506:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1790919256.086513:0:14433:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+18:14436:x1877914550379008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790919256.086781:0:14433:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+18:14436:x1877914550379008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 268us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919256.086789:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1790919256.086819:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:78fab146-b05d-43bc-9885-013f4b87a754:14436:1877914550379008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790919256.086846:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:78fab146-b05d-43bc-9885-013f4b87a754:14436:1877914550379136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790919256.086885:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919256.086898:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bd82c4e000 going to sleep for 11 seconds 00000100:00100000:1.0:1790919256.086907:0:14433:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550379136 00000100:00100000:1.0:1790919256.086911:0:14433:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550379136 00000100:00100000:1.0:1790919256.086928:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1790919256.086933:0:14433:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+18:14436:x1877914550379136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790919256.087069:0:14433:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+18:14436:x1877914550379136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919256.087075:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1790919256.087106:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:78fab146-b05d-43bc-9885-013f4b87a754:14436:1877914550379136:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790919256.089123:0:16634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1790919256.089251:0:14436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1790919256.089271:0:14436:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790919256.089281:0:14436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be81517600/0xc3296956897c568e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c5695 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919256.089292:0:14436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88be81517600/0xc3296956897c568e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c5695 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919256.089302:0:14436:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790919256.089305:0:14436:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88beb3f1f800 from 10 10000000:01000000:1.0:1790919256.089307:0:14436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790919256.089336:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be81517400/0xc3296956897c569c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919256.089344:0:14436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff88be81517400/0xc3296956897c569c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919256.089354:0:14436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff88be81517400/0xc3296956897c569c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919256.089375:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:78fab146-b05d-43bc-9885-013f4b87a754:14436:1877914550379264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790919256.089428:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919256.089448:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bd82c4e900 going to sleep for 11 seconds 00000100:00100000:1.0:1790919256.089467:0:14433:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550379264 00000100:00100000:1.0:1790919256.089473:0:14433:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550379264 00000100:00100000:1.0:1790919256.089501:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1790919256.089508:0:14433:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+18:14436:x1877914550379264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790919256.089520:0:14433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919256.089546:0:14433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88be81517000/0xc3296956897c56a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3296956897c569c expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919256.089580:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88be81517000/0xc3296956897c56a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3296956897c569c expref: 19 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919256.089588:0:14433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88be81517000/0xc3296956897c56a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3296956897c569c expref: 19 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919256.089596:0:14433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81517000, rc 0) 00000100:00100000:1.0:1790919256.089627:0:14433:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+19:14436:x1877914550379264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919256.089634:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1790919256.089670:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:78fab146-b05d-43bc-9885-013f4b87a754:14436:1877914550379264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790919256.089682:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff88be81517400/0xc3296956897c569c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c56a3 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919256.089690:0:14436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff88be81517400/0xc3296956897c569c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3296956897c56a3 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919256.089731:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:78fab146-b05d-43bc-9885-013f4b87a754:14436:1877914550379392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790919256.089754:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919256.089766:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be8e285300 going to sleep for 11 seconds 00000100:00100000:1.0:1790919256.089776:0:14433:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550379392 00000100:00100000:1.0:1790919256.089780:0:14433:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550379392 00000100:00100000:1.0:1790919256.089794:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1790919256.089798:0:14433:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+19:14436:x1877914550379392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790919256.091296:0:14433:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+19:14436:x1877914550379392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1490us (1534us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919256.091316:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1790919256.096895:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:78fab146-b05d-43bc-9885-013f4b87a754:14436:1877914550379392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790919256.097170:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:78fab146-b05d-43bc-9885-013f4b87a754:14436:1877914550379520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790919256.097317:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919256.097358:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be8e285300 going to sleep for 11 seconds 00000100:00100000:0.0:1790919256.097411:0:14432:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550379520 00000100:00100000:0.0:1790919256.097419:0:14432:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550379520 00000100:00100000:0.0:1790919256.097471:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1790919256.097481:0:14432:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78fab146-b05d-43bc-9885-013f4b87a754+19:14436:x1877914550379520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790919256.097727:0:14432:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78fab146-b05d-43bc-9885-013f4b87a754+19:14436:x1877914550379520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 246us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919256.097735:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1790919256.097864:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:78fab146-b05d-43bc-9885-013f4b87a754:14436:1877914550379520:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790919256.098777:0:16637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1790919256.099122:0:14436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1790919256.099146:0:14436:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790919256.099156:0:14436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff88be81517400/0xc3296956897c569c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c56a3 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919256.099168:0:14436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff88be81517400/0xc3296956897c569c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3296956897c56a3 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919256.959772:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919257.343790:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebf788000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550379648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790919257.343864:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919257.344111:0:15126:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550379648 00000100:00100000:3.0:1790919257.344120:0:15126:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550379648 00000100:00100000:3.0:1790919257.344176:0:15126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790919257.344186:0:15126:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550379648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790919257.344219:0:15126:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919257.344262:0:15126:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550379648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919257.344269:0:15126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1790919257.344305:0:14435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790919257.345582:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebf788000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550379648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790919257.805637:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919257.805688:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919257.805726:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919257.805728:0:14434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532560256 00000100:00100000:1.0:1790919257.805740:0:14434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532560256 00000100:00100000:3.0:1790919257.805763:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919257.805800:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919257.805811:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 120 00000100:00100000:1.0:1790919257.805823:0:14434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f601f44-7343-45ca-9d5e-f7bb6777e55d+13:2351:x1877914532560256:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1790919257.805832:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919257.805861:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919257.805881:0:14439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532560768 00000100:00100000:3.0:1790919257.805885:0:14439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532560768 00000100:00100000:1.0:1790919257.805900:0:14434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f601f44-7343-45ca-9d5e-f7bb6777e55d+13:2351:x1877914532560256:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 79us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919257.805907:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 120 00000100:00100000:3.0:1790919257.805927:0:14439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532560384 00000100:00100000:3.0:1790919257.805944:0:14439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532560384 00000100:00100000:1.0:1790919257.805958:0:15125:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532560512 00000100:00100000:1.0:1790919257.805963:0:15125:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532560512 00000100:00100000:3.0:1790919257.805977:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 24 00000100:00100000:3.0:1790919257.805988:0:14439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf78b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:971222de-c593-4f1b-9c93-71dc3d112472+6:2351:x1877914532560768:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:1.0:1790919257.805989:0:15125:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532561024 00000100:00100000:1.0:1790919257.805994:0:15125:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532561024 00000100:00100000:1.0:1790919257.806008:0:15125:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532560640 00000100:00100000:1.0:1790919257.806011:0:15125:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532560640 00000100:00100000:1.0:1790919257.806024:0:15125:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532560896 00000100:00100000:1.0:1790919257.806027:0:15125:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532560896 00000100:00100000:3.0:1790919257.806032:0:14439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf78b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:971222de-c593-4f1b-9c93-71dc3d112472+6:2351:x1877914532560768:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 45us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919257.806041:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 24 00000100:00100000:1.0:1790919257.806045:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 12 00000100:00100000:1.0:1790919257.806066:0:15125:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf788000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a397f618-6104-4fd0-addb-afcbd50d641f+5:2351:x1877914532560512:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1790919257.806073:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 25 00000100:00100000:3.0:1790919257.806083:0:14439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf78b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a397f618-6104-4fd0-addb-afcbd50d641f+6:2351:x1877914532560384:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:1.0:1790919257.806100:0:15125:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf788000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a397f618-6104-4fd0-addb-afcbd50d641f+5:2351:x1877914532560512:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 34us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919257.806109:0:14439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf78b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a397f618-6104-4fd0-addb-afcbd50d641f+6:2351:x1877914532560384:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 28us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919257.806113:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 25 00000100:00100000:1.0:1790919257.806126:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 12 00000100:00100000:3.0:1790919257.806128:0:15124:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1790919257.806134:0:15124:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1790919257.806148:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 13 00000100:00080000:3.0:1790919257.806153:0:14435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790919257.806158:0:14435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790919257.806158:0:15125:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf78a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:971222de-c593-4f1b-9c93-71dc3d112472+5:2351:x1877914532561024:12345-192.168.201.27@tcp:400:kworker.0 00000100:00080000:3.0:1790919257.806162:0:14435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790919257.806193:0:15125:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf78a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:971222de-c593-4f1b-9c93-71dc3d112472+5:2351:x1877914532561024:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 38us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919257.806199:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 13 00000100:00100000:1.0:1790919257.806210:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 14 00000100:00100000:1.0:1790919257.806217:0:15125:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a397f618-6104-4fd0-addb-afcbd50d641f+5:2351:x1877914532560640:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:1.0:1790919257.806238:0:15125:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a397f618-6104-4fd0-addb-afcbd50d641f+5:2351:x1877914532560640:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 22us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919257.806245:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 14 00000100:00100000:3.0:1790919257.806819:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 15 00000100:00100000:3.0:1790919257.806832:0:15124:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:971222de-c593-4f1b-9c93-71dc3d112472+5:2351:x1877914532560896:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1790919257.806898:0:15124:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:971222de-c593-4f1b-9c93-71dc3d112472+5:2351:x1877914532560896:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 67us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919257.806902:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 15 00000100:00100000:3.0:1790919257.813467:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919257.813585:0:14439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532561152 00000100:00100000:0.0:1790919257.813595:0:14439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532561152 00000100:00100000:0.0:1790919257.813659:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 15 00000100:00100000:0.0:1790919257.813669:0:14439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a397f618-6104-4fd0-addb-afcbd50d641f+6:14385:x1877914532561152:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790919257.813690:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919257.813728:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c56aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672d057 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919257.813796:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58800/0xc3296956897c56b1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919257.813812:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58800/0xc3296956897c56b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919257.813827:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58800/0xc3296956897c56b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919257.813841:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c56b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919257.813848:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c56b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919257.813854:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c56b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919257.814180:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58600/0xc3296956897c56bf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919257.814189:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58600/0xc3296956897c56bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919257.814196:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58600/0xc3296956897c56bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919257.814218:0:14439:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790919257.814221:0:14439:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790919257.814255:0:14439:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58600/0xc3296956897c56bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919257.814271:0:14439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58800/0xc3296956897c56b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919257.814277:0:14439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58800/0xc3296956897c56b1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919257.814283:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58800/0xc3296956897c56b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919257.814289:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac58800 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919257.814293:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58800/0xc3296956897c56b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919257.814300:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58800/0xc3296956897c56b1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919257.814311:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be8b621d00) 00010000:00010000:0.0:1790919257.814314:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919257.814318:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58800/0xc3296956897c56b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919257.814324:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58800/0xc3296956897c56b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919257.814337:0:14439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c56b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919257.814343:0:14439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c56b8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919257.814348:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c56b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919257.814993:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac59400 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919257.814997:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c56b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919257.815004:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c56b8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919257.815014:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff88be853b5b00) 00010000:00010000:0.0:1790919257.815016:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919257.815019:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c56b8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919257.815024:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c56b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919257.815102:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c56aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d057 expref: 8 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919257.815116:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58600/0xc3296956897c56bf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d057 expref: 7 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919257.815123:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88be853b5c00) 00010000:00010000:0.0:1790919257.815125:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790919257.815127:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac58600, rc 0) 00000100:00100000:0.0:1790919257.815203:0:14439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a397f618-6104-4fd0-addb-afcbd50d641f+7:14385:x1877914532561152:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 1535us (1748us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919257.815211:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 15 00000100:00100000:0.0:1790919257.819366:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919257.819466:0:14441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532561408 00000100:00100000:3.0:1790919257.819477:0:14441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532561408 00000100:00100000:3.0:1790919257.819592:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 16 00000100:00100000:3.0:1790919257.819604:0:14441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a397f618-6104-4fd0-addb-afcbd50d641f+7:14385:x1877914532561408:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790919257.819628:0:14441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919257.819657:0:14441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3000/0xc3296956897c56c6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672d05e expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919257.819741:0:14441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2400/0xc3296956897c56cd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919257.819755:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2400/0xc3296956897c56cd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919257.819767:0:14441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2400/0xc3296956897c56cd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919257.819836:0:14441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3c00/0xc3296956897c56d4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919257.819844:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3c00/0xc3296956897c56d4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919257.819849:0:14441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3c00/0xc3296956897c56d4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919257.820200:0:14441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f800/0xc3296956897c56db lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919257.820209:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f800/0xc3296956897c56db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919257.820216:0:14441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f800/0xc3296956897c56db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919257.820226:0:14441:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1790919257.820413:0:14441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2400/0xc3296956897c56cd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919257.820421:0:14441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2400/0xc3296956897c56cd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919257.820427:0:14441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2400/0xc3296956897c56cd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919257.820433:0:14441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be813a2400 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919257.820437:0:14441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2400/0xc3296956897c56cd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919257.820444:0:14441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2400/0xc3296956897c56cd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919257.820457:0:14441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88be853b5c00) 00010000:00010000:3.0:1790919257.820460:0:14441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919257.820465:0:14441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2400/0xc3296956897c56cd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919257.820481:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a2400/0xc3296956897c56cd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919257.820497:0:14441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3c00/0xc3296956897c56d4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919257.820503:0:14441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3c00/0xc3296956897c56d4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919257.820509:0:14441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3c00/0xc3296956897c56d4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919257.820513:0:14441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be813a3c00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919257.820516:0:14441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3c00/0xc3296956897c56d4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919257.820521:0:14441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3c00/0xc3296956897c56d4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919257.820552:0:14441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff88be88e22900) 00010000:00010000:3.0:1790919257.820555:0:14441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919257.820558:0:14441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3c00/0xc3296956897c56d4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919257.820564:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3c00/0xc3296956897c56d4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919257.823306:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be813a3000/0xc3296956897c56c6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d05e expref: 10 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919257.823421:0:14441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f800/0xc3296956897c56db lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d05e expref: 9 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919257.823432:0:14441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88be88e22600) 00010000:00010000:3.0:1790919257.823435:0:14441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919257.823438:0:14441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be90f9f800, rc 0) 00000100:00100000:3.0:1790919257.823951:0:14441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a397f618-6104-4fd0-addb-afcbd50d641f+9:14385:x1877914532561408:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 4347us (4603us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1790919257.823960:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 16 00000100:00100000:1.0:1790919257.830860:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919257.832554:0:14440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532561536 00000100:00100000:3.0:1790919257.832569:0:14440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532561536 00000100:00100000:3.0:1790919257.832640:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 17 00000100:00100000:3.0:1790919257.832650:0:14440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a397f618-6104-4fd0-addb-afcbd50d641f+9:14385:x1877914532561536:12345-192.168.201.27@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1790919257.832774:0:14440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a397f618-6104-4fd0-addb-afcbd50d641f+9:14385:x1877914532561536:12345-192.168.201.27@tcp:59:lhsmtool_posix.0 Request processed in 125us (1922us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919257.832782:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 17 00000100:00100000:0.0:1790919257.899130:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919257.899294:0:15856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532561664 00000100:00100000:1.0:1790919257.899306:0:15856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532561664 00000100:00100000:1.0:1790919257.899419:0:15856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 18 00000100:00100000:1.0:1790919257.899430:0:15856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a397f618-6104-4fd0-addb-afcbd50d641f+9:14391:x1877914532561664:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:1.0:1790919257.899453:0:15856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919257.899484:0:15856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517200/0xc3296956897c56e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672d065 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919257.899621:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516800/0xc3296956897c56f0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919257.899637:0:15856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516800/0xc3296956897c56f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919257.899666:0:15856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516800/0xc3296956897c56f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919257.899683:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c56f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919257.899691:0:15856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c56f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919257.899698:0:15856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c56f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919257.899881:0:15856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516800/0xc3296956897c56f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919257.899890:0:15856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516800/0xc3296956897c56f0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919257.899897:0:15856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516800/0xc3296956897c56f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919257.899904:0:15856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81516800 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:1.0:1790919257.899908:0:15856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516800/0xc3296956897c56f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919257.899915:0:15856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516800/0xc3296956897c56f0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919257.899928:0:15856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be8b621d00) 00010000:00010000:1.0:1790919257.899943:0:15856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919257.899948:0:15856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516800/0xc3296956897c56f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919257.899961:0:15856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516800/0xc3296956897c56f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919257.899975:0:15856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c56f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919257.899982:0:15856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c56f7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919257.899988:0:15856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c56f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919257.899994:0:15856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81516600 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:1.0:1790919257.899997:0:15856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c56f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919257.900003:0:15856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c56f7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919257.900012:0:15856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff88be86130500) 00010000:00010000:1.0:1790919257.900015:0:15856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919257.900017:0:15856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c56f7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919257.900023:0:15856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c56f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919257.900066:0:15856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517200/0xc3296956897c56e9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d065 expref: 10 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919257.900087:0:15856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be8b621d00) 00010000:00010000:1.0:1790919257.900090:0:15856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919257.900094:0:15856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517200/0xc3296956897c56e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d065 expref: 10 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919257.900104:0:15856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81517200, rc 0) 00000100:00100000:1.0:1790919257.900162:0:15856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a397f618-6104-4fd0-addb-afcbd50d641f+9:14391:x1877914532561664:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 734us (1042us total) trans 0 rc 301/301 00000100:00100000:1.0:1790919257.900170:0:15856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 18 00000100:00100000:0.0:1790919257.907773:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919257.909091:0:14448:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532561792 00000100:00100000:2.0:1790919257.909104:0:14448:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532561792 00000100:00100000:2.0:1790919257.909169:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 0 00000100:00100000:2.0:1790919257.909180:0:14448:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a397f618-6104-4fd0-addb-afcbd50d641f+9:14391:x1877914532561792:12345-192.168.201.27@tcp:700:lfs.0 00000100:00100000:2.0:1790919257.909271:0:14448:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a397f618-6104-4fd0-addb-afcbd50d641f+9:14391:x1877914532561792:12345-192.168.201.27@tcp:700:lfs.0 Request processed in 92us (1508us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919257.909279:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 0 00000100:00100000:0.0:1790919257.922903:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919257.923176:0:14439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532562048 00000100:00100000:3.0:1790919257.923188:0:14439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532562048 00000100:00100000:3.0:1790919257.923247:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 19 00000100:00100000:3.0:1790919257.923257:0:14439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a397f618-6104-4fd0-addb-afcbd50d641f+9:14391:x1877914532562048:12345-192.168.201.27@tcp:36:lfs.0 00010000:00010000:3.0:1790919257.923324:0:14439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919257.923471:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387800/0xc3296956897c562c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672cfe0 expref: 9 pid: 14440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919257.923492:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be8b621d00) 00010000:00010000:3.0:1790919257.923814:0:14439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790919257.924030:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f200/0xc3296956897c56fe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919257.924055:0:14439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517e00/0xc3296956897c5664 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d042 expref: 5 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919257.924064:0:14439:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f200/0xc3296956897c56fe lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919257.924097:0:14439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517e00/0xc3296956897c5664 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672d042 expref: 5 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919257.924112:0:14439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517e00/0xc3296956897c5664 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672d042 expref: 5 pid: 14439 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919257.924126:0:14439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb35b0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14439:1877914550379776:192.168.201.27@tcp:104: 00000100:00100000:3.0:1790919257.924222:0:14439:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be8652ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790919257.931393:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919257.931487:0:14427:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532562176 00000100:00100000:1.0:1790919257.931497:0:14427:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532562176 00010000:00010000:1.0:1790919257.931570:0:14427:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517e00/0xc3296956897c5664 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672d042 expref: 6 pid: 14439 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919257.931609:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 9 00000100:00100000:1.0:1790919257.931619:0:14427:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:971222de-c593-4f1b-9c93-71dc3d112472+6:2352:x1877914532562176:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790919257.931634:0:14427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919257.931642:0:14427:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517e00/0xc3296956897c5664 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672d042 expref: 6 pid: 14439 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919257.931654:0:14427:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517e00/0xc3296956897c5664 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672d042 expref: 6 pid: 14439 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919257.931676:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be8b621d00) 00010000:00010000:1.0:1790919257.931681:0:14427:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f200/0xc3296956897c56fe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919257.931705:0:14427:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f200/0xc3296956897c56fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919257.931712:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f200/0xc3296956897c56fe lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919257.931732:0:14427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919257.931796:0:14427:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:971222de-c593-4f1b-9c93-71dc3d112472+6:2352:x1877914532562176:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 179us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919257.931804:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 9 00010000:00010000:0.0:1790919257.932010:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517e00/0xc3296956897c5664 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672d042 expref: 5 pid: 14439 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919257.932027:0:14439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb35b0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14439:1877914550379776:192.168.201.27@tcp:104: 00010000:00010000:0.0:1790919257.932061:0:14439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f200/0xc3296956897c56fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919257.932072:0:14439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f200/0xc3296956897c56fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919257.932078:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f200/0xc3296956897c56fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919257.932101:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58800/0xc3296956897c5705 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919257.932110:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58800/0xc3296956897c5705 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919257.932118:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58800/0xc3296956897c5705 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919257.934714:0:14439:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1790919257.934730:0:14439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f200/0xc3296956897c56fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919257.934739:0:14439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f200/0xc3296956897c56fe lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919257.934757:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f200/0xc3296956897c56fe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919257.935876:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be90f9f200 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919257.935886:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f200/0xc3296956897c56fe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919257.935898:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f200/0xc3296956897c56fe lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919257.935915:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be8b621d00) 00010000:00010000:0.0:1790919257.935918:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919257.935923:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f200/0xc3296956897c56fe lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919257.935941:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f200/0xc3296956897c56fe lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790919257.935969:0:14439:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000070110308 reply state 00000000c7decf4d transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58800/0xc3296956897c5705 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919257.935979:0:14439:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790919257.936702:0:14439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a397f618-6104-4fd0-addb-afcbd50d641f+10:14391:x1877914532562048:12345-192.168.201.27@tcp:36:lfs.0 Request processed in 13441us (13805us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1790919257.936712:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 19 00010000:00010000:0.0:1790919257.955412:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58800/0xc3296956897c5705 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919257.955430:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58800/0xc3296956897c5705 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919257.955455:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58800/0xc3296956897c5705 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919257.955461:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac58800 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919257.955466:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58800/0xc3296956897c5705 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919257.955474:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58800/0xc3296956897c5705 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919257.955490:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff88be853b5b00) 00010000:00010000:0.0:1790919257.955493:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919257.955499:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58800/0xc3296956897c5705 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919257.955505:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58800/0xc3296956897c5705 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919257.983758:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919258.055110:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919258.055376:0:14441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532562304 00000100:00100000:0.0:1790919258.055387:0:14441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532562304 00000100:00100000:0.0:1790919258.055452:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 20 00000100:00100000:0.0:1790919258.055462:0:14441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a397f618-6104-4fd0-addb-afcbd50d641f+9:14399:x1877914532562304:12345-192.168.201.27@tcp:101:lctl.0 00010000:00010000:0.0:1790919258.055487:0:14441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919258.055519:0:14441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58800/0xc3296956897c570c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672d06c expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.055614:0:14441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c5713 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.055646:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c5713 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.055658:0:14441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c5713 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919258.055693:0:14441:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790919258.055696:0:14441:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790919258.055736:0:14441:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c5713 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.055773:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58800/0xc3296956897c570c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d06c expref: 11 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.055793:0:14441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59e00/0xc3296956897c5713 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d06c expref: 10 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.055802:0:14441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be853b5b00) 00010000:00010000:0.0:1790919258.055805:0:14441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790919258.055809:0:14441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac59e00, rc 0) 00000100:00100000:0.0:1790919258.055875:0:14441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a397f618-6104-4fd0-addb-afcbd50d641f+10:14399:x1877914532562304:12345-192.168.201.27@tcp:101:lctl.0 Request processed in 414us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919258.055882:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 20 00000100:00100000:3.0:1790919258.091214:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919258.092034:0:14440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532562432 00000100:00100000:0.0:1790919258.092046:0:14440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532562432 00000100:00100000:0.0:1790919258.092119:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 21 00000100:00100000:0.0:1790919258.092129:0:14440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:971222de-c593-4f1b-9c93-71dc3d112472+5:14400:x1877914532562432:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:0.0:1790919258.092149:0:14440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919258.092182:0:14440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58800/0xc3296956897c571a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672d073 expref: -99 pid: 14440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.092251:0:14440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c5721 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.092264:0:14440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c5721 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.092275:0:14440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c5721 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919258.092310:0:14440:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790919258.092313:0:14440:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790919258.092330:0:14440:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c5721 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.092368:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58800/0xc3296956897c571a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d073 expref: 7 pid: 14440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.092388:0:14440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58200/0xc3296956897c5721 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d073 expref: 6 pid: 14440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.092396:0:14440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be853b5b00) 00010000:00010000:0.0:1790919258.092398:0:14440:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790919258.092402:0:14440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac58200, rc 0) 00000100:00100000:0.0:1790919258.092476:0:14440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:971222de-c593-4f1b-9c93-71dc3d112472+6:14400:x1877914532562432:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 348us (1273us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919258.092484:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 21 00000100:00100000:2.0:1790919258.096941:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919258.097209:0:14441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532562560 00000100:00100000:0.0:1790919258.097232:0:14441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532562560 00000100:00100000:0.0:1790919258.097355:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 22 00000100:00100000:0.0:1790919258.097368:0:14441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:971222de-c593-4f1b-9c93-71dc3d112472+6:14400:x1877914532562560:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:0.0:1790919258.097390:0:14441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919258.097409:0:14441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c5728 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672d07a expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.097472:0:14441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59c00/0xc3296956897c572f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.097486:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59c00/0xc3296956897c572f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.097497:0:14441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59c00/0xc3296956897c572f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.097510:0:14441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c5736 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.097517:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c5736 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.097523:0:14441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c5736 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.097720:0:14441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58800/0xc3296956897c573d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.097729:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58800/0xc3296956897c573d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.097736:0:14441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58800/0xc3296956897c573d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919258.097774:0:14441:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790919258.097778:0:14441:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790919258.097797:0:14441:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58800/0xc3296956897c573d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.097809:0:14441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59c00/0xc3296956897c572f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.097815:0:14441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59c00/0xc3296956897c572f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.097822:0:14441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59c00/0xc3296956897c572f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.097827:0:14441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac59c00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919258.097831:0:14441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59c00/0xc3296956897c572f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.097838:0:14441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59c00/0xc3296956897c572f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.097850:0:14441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be853b5b00) 00010000:00010000:0.0:1790919258.097853:0:14441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919258.097858:0:14441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59c00/0xc3296956897c572f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.097864:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59c00/0xc3296956897c572f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.097877:0:14441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c5736 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.097893:0:14441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c5736 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.097899:0:14441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c5736 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.097903:0:14441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac59400 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919258.097906:0:14441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c5736 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.097912:0:14441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c5736 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.097919:0:14441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff88be853b5f00) 00010000:00010000:0.0:1790919258.097922:0:14441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919258.097924:0:14441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c5736 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.097941:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59400/0xc3296956897c5736 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.097975:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c5728 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d07a expref: 8 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.097988:0:14441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58800/0xc3296956897c573d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d07a expref: 7 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.097994:0:14441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88be853b5700) 00010000:00010000:0.0:1790919258.097996:0:14441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790919258.098004:0:14441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac58800, rc 0) 00000100:00100000:0.0:1790919258.098134:0:14441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:971222de-c593-4f1b-9c93-71dc3d112472+7:14400:x1877914532562560:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 768us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919258.098141:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 22 00000100:00100000:1.0:1790919258.102501:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919258.102954:0:14440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532562816 00000100:00100000:0.0:1790919258.102965:0:14440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532562816 00000100:00100000:0.0:1790919258.103395:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 23 00000100:00100000:0.0:1790919258.103406:0:14440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:971222de-c593-4f1b-9c93-71dc3d112472+7:14400:x1877914532562816:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:0.0:1790919258.103429:0:14440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919258.103451:0:14440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c5744 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672d081 expref: -99 pid: 14440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919258.103575:0:14440:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1790919258.103724:0:14440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c5744 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d081 expref: 9 pid: 14440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.103737:0:14440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be853b5b00) 00010000:00010000:0.0:1790919258.103740:0:14440:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790919258.103746:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c5744 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d081 expref: 9 pid: 14440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.103759:0:14440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88bebac58a00, rc 0) 00000100:00100000:0.0:1790919258.103825:0:14440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:971222de-c593-4f1b-9c93-71dc3d112472+8:14400:x1877914532562816:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 421us (1334us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1790919258.103833:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 23 00000100:00100000:1.0:1790919258.106646:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919258.106822:0:15856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532563072 00000100:00100000:2.0:1790919258.106832:0:15856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532563072 00000100:00100000:2.0:1790919258.106892:0:15856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 24 00000100:00100000:2.0:1790919258.106903:0:15856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:971222de-c593-4f1b-9c93-71dc3d112472+8:14400:x1877914532563072:12345-192.168.201.27@tcp:36:lfs.0 00010000:00010000:2.0:1790919258.106969:0:15856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919258.106995:0:15856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58800/0xc3296956897c573d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d07a expref: 8 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.107016:0:15856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88be853b5700) 00010000:00010000:2.0:1790919258.107028:0:15856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790919258.107276:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386800/0xc3296956897c5752 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.107291:0:15856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386800/0xc3296956897c5752 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.107300:0:15856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386800/0xc3296956897c5752 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790919258.107506:0:15856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b36f528a reply state 0000000088b9c675 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386800/0xc3296956897c5752 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919258.107516:0:15856:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1790919258.107523:0:15856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1790919258.107690:0:15856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:971222de-c593-4f1b-9c93-71dc3d112472+9:14400:x1877914532563072:12345-192.168.201.27@tcp:36:lfs.0 Request processed in 789us (1053us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1790919258.107699:0:15856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 24 00000100:00100000:2.0:1790919258.110104:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919258.110143:0:14442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532563328 00000100:00100000:2.0:1790919258.110165:0:14442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532563328 00000100:00100000:2.0:1790919258.110212:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 2 00000100:00100000:2.0:1790919258.110222:0:14442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:971222de-c593-4f1b-9c93-71dc3d112472+9:14400:x1877914532563328:12345-192.168.201.27@tcp:35:lfs.0 00000100:00100000:2.0:1790919258.110444:0:14442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:971222de-c593-4f1b-9c93-71dc3d112472+10:14400:x1877914532563328:12345-192.168.201.27@tcp:35:lfs.0 Request processed in 222us (346us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1790919258.110451:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 2 00010000:00010000:3.0:1790919258.111331:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386800/0xc3296956897c5752 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.111346:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386800/0xc3296956897c5752 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.111354:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386800/0xc3296956897c5752 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.111373:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386800 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919258.111379:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386800/0xc3296956897c5752 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.111386:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386800/0xc3296956897c5752 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.111401:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88be8b621400) 00010000:00010000:3.0:1790919258.111404:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1790919258.111409:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386800/0xc3296956897c5752 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.111415:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386800/0xc3296956897c5752 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919258.113515:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919258.113783:0:14439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532563584 00000100:00100000:3.0:1790919258.113793:0:14439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532563584 00000100:00100000:3.0:1790919258.113888:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 25 00000100:00100000:3.0:1790919258.113898:0:14439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:971222de-c593-4f1b-9c93-71dc3d112472+9:14400:x1877914532563584:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:3.0:1790919258.113921:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919258.113950:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e200/0xc3296956897c5759 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672d088 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.114022:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ec00/0xc3296956897c5760 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.114037:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ec00/0xc3296956897c5760 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.114065:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ec00/0xc3296956897c5760 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.114093:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fa00/0xc3296956897c5767 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.114101:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fa00/0xc3296956897c5767 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.114108:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fa00/0xc3296956897c5767 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919258.114213:0:14439:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1790919258.114297:0:14439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ec00/0xc3296956897c5760 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.114306:0:14439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ec00/0xc3296956897c5760 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.114313:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ec00/0xc3296956897c5760 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.114319:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be90f9ec00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919258.114322:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ec00/0xc3296956897c5760 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.114330:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ec00/0xc3296956897c5760 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.114341:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be853b5b00) 00010000:00010000:3.0:1790919258.114344:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919258.114349:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ec00/0xc3296956897c5760 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.114365:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ec00/0xc3296956897c5760 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.114378:0:14439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fa00/0xc3296956897c5767 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.114384:0:14439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fa00/0xc3296956897c5767 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.114389:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fa00/0xc3296956897c5767 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.114394:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be90f9fa00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919258.114397:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fa00/0xc3296956897c5767 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.114403:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fa00/0xc3296956897c5767 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.114411:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff88be88e22900) 00010000:00010000:3.0:1790919258.114413:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919258.114415:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fa00/0xc3296956897c5767 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.114420:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fa00/0xc3296956897c5767 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.114457:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e200/0xc3296956897c5759 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d088 expref: 11 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.114478:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be853b5b00) 00010000:00010000:3.0:1790919258.114480:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790919258.114484:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e200/0xc3296956897c5759 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d088 expref: 11 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.114493:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be90f9e200, rc 0) 00000100:00100000:3.0:1790919258.114712:0:14439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:971222de-c593-4f1b-9c93-71dc3d112472+10:14400:x1877914532563584:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 815us (1205us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1790919258.114720:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 25 00000100:00100000:2.0:1790919258.117857:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919258.117953:0:14441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532563712 00000100:00100000:3.0:1790919258.117963:0:14441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532563712 00000100:00100000:3.0:1790919258.118058:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 26 00000100:00100000:3.0:1790919258.118068:0:14441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:971222de-c593-4f1b-9c93-71dc3d112472+10:14400:x1877914532563712:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:3.0:1790919258.118092:0:14441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919258.118115:0:14441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e000/0xc3296956897c5775 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672d08f expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.118195:0:14441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c577c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.118208:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c577c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.118220:0:14441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c577c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919258.118243:0:14441:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790919258.118258:0:14441:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790919258.118278:0:14441:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c577c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.118303:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e000/0xc3296956897c5775 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d08f expref: 12 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.118319:0:14441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c577c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d08f expref: 11 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.118329:0:14441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88be88e22300) 00010000:00010000:3.0:1790919258.118332:0:14441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790919258.118335:0:14441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be90f9f600, rc 0) 00000100:00100000:3.0:1790919258.118394:0:14441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:971222de-c593-4f1b-9c93-71dc3d112472+11:14400:x1877914532563712:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 327us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919258.118401:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 26 00000100:00100000:0.0:1790919258.121899:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919258.122025:0:14442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532563840 00000100:00100000:2.0:1790919258.122035:0:14442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532563840 00000100:00100000:2.0:1790919258.122180:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 3 00000100:00100000:2.0:1790919258.122191:0:14442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:971222de-c593-4f1b-9c93-71dc3d112472+11:14400:x1877914532563840:12345-192.168.201.27@tcp:37:lfs.0 00000100:00100000:0.0:1790919258.134886:0:14442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:971222de-c593-4f1b-9c93-71dc3d112472+11:14400:x1877914532563840:12345-192.168.201.27@tcp:37:lfs.0 Request processed in 12685us (12984us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919258.134921:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 3 00000100:00100000:2.0:1790919258.143294:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919258.143365:0:14443:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532564096 00000100:00100000:3.0:1790919258.143375:0:14443:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532564096 00000100:00100000:3.0:1790919258.143433:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 4 00000100:00100000:3.0:1790919258.143443:0:14443:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebccd6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:971222de-c593-4f1b-9c93-71dc3d112472+11:14400:x1877914532564096:12345-192.168.201.27@tcp:35:lfs.0 00000100:00100000:3.0:1790919258.143836:0:14443:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebccd6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:971222de-c593-4f1b-9c93-71dc3d112472+12:14400:x1877914532564096:12345-192.168.201.27@tcp:35:lfs.0 Request processed in 393us (548us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1790919258.143845:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 4 00000100:00100000:0.0:1790919258.201639:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919258.202302:0:15856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532564224 00000100:00100000:2.0:1790919258.202313:0:15856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532564224 00000100:00100000:2.0:1790919258.202376:0:15856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 27 00000100:00100000:2.0:1790919258.202386:0:15856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a397f618-6104-4fd0-addb-afcbd50d641f+10:14406:x1877914532564224:12345-192.168.201.27@tcp:101:bash.0 00010000:00010000:2.0:1790919258.202407:0:15856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919258.202430:0:15856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c5783 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672d096 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.202497:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386800/0xc3296956897c578a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.202511:0:15856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386800/0xc3296956897c578a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.202522:0:15856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386800/0xc3296956897c578a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.202586:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c5791 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.202594:0:15856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c5791 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.202600:0:15856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c5791 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.202694:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c5798 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.202703:0:15856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c5798 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.202710:0:15856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c5798 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919258.202735:0:15856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790919258.202739:0:15856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790919258.202775:0:15856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c5798 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.202785:0:15856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386800/0xc3296956897c578a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.202791:0:15856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386800/0xc3296956897c578a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.202798:0:15856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386800/0xc3296956897c578a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.202814:0:15856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386800 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919258.202818:0:15856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386800/0xc3296956897c578a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.202827:0:15856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386800/0xc3296956897c578a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.202838:0:15856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be853b5b00) 00010000:00010000:2.0:1790919258.202840:0:15856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919258.202845:0:15856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386800/0xc3296956897c578a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.202850:0:15856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386800/0xc3296956897c578a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.202863:0:15856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c5791 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.202869:0:15856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c5791 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.202874:0:15856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c5791 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.202879:0:15856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386c00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919258.202881:0:15856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c5791 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.202887:0:15856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c5791 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.202905:0:15856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff88be8b621400) 00010000:00010000:2.0:1790919258.202907:0:15856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919258.202910:0:15856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c5791 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.202915:0:15856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c5791 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.202956:0:15856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387c00/0xc3296956897c5783 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d096 expref: 12 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.202968:0:15856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387400/0xc3296956897c5798 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d096 expref: 11 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.202975:0:15856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88be88e22300) 00010000:00010000:2.0:1790919258.202977:0:15856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1790919258.202979:0:15856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be88387400, rc 0) 00000100:00100000:2.0:1790919258.203206:0:15856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a397f618-6104-4fd0-addb-afcbd50d641f+11:14406:x1877914532564224:12345-192.168.201.27@tcp:101:bash.0 Request processed in 652us (1410us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919258.203213:0:15856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 27 00000100:00100000:1.0:1790919258.208444:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919258.208597:0:14440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532564480 00000100:00100000:0.0:1790919258.208608:0:14440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532564480 00000100:00100000:0.0:1790919258.208683:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 28 00000100:00100000:0.0:1790919258.208694:0:14440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a397f618-6104-4fd0-addb-afcbd50d641f+11:14406:x1877914532564480:12345-192.168.201.27@tcp:101:bash.0 00010000:00010000:0.0:1790919258.208716:0:14440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919258.208739:0:14440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59c00/0xc3296956897c579f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672d09d expref: -99 pid: 14440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.208859:0:14440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58400/0xc3296956897c57a6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.208874:0:14440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c577c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d08f expref: 11 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.208883:0:14440:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58400/0xc3296956897c57a6 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.208919:0:14440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c577c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672d08f expref: 11 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.208943:0:14440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c577c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672d08f expref: 11 pid: 14441 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919258.208956:0:14440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb0b1fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14440:1877914550379904:192.168.201.27@tcp:104: 00000100:00100000:0.0:1790919258.209360:0:14440:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb0b046c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790919258.212355:0:14440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb0b1fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14440:1877914550379904:192.168.201.27@tcp:104: 00010000:00010000:3.0:1790919258.212385:0:14440:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58400/0xc3296956897c57a6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919258.213781:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919258.214277:0:16559:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532564608 00000100:00100000:0.0:1790919258.214287:0:16559:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532564608 00010000:00010000:0.0:1790919258.214330:0:16559:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c577c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672d08f expref: 12 pid: 14441 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919258.214372:0:16559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 10 00000100:00100000:0.0:1790919258.214381:0:16559:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:971222de-c593-4f1b-9c93-71dc3d112472+12:2353:x1877914532564608:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790919258.214396:0:16559:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919258.214403:0:16559:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c577c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672d08f expref: 12 pid: 14441 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.214416:0:16559:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c577c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672d08f expref: 12 pid: 14441 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.214437:0:16559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9f600/0xc3296956897c577c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672d08f expref: 12 pid: 14441 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.214454:0:16559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88be88e22300) 00010000:00010000:0.0:1790919258.214459:0:16559:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58400/0xc3296956897c57a6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.214469:0:16559:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58400/0xc3296956897c57a6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.214476:0:16559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58400/0xc3296956897c57a6 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.214508:0:16559:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919258.214607:0:16559:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:971222de-c593-4f1b-9c93-71dc3d112472+11:2353:x1877914532564608:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 226us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919258.214627:0:16559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 10 00010000:00010000:3.0:1790919258.214749:0:14440:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58400/0xc3296956897c57a6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.214765:0:14440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58400/0xc3296956897c57a6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.214839:0:14440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e000/0xc3296956897c57ad lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.214850:0:14440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e000/0xc3296956897c57ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.214857:0:14440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e000/0xc3296956897c57ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.219998:0:14440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c57b4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.220020:0:14440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c57b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.220032:0:14440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c57b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919258.220068:0:14440:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790919258.220112:0:14440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58400/0xc3296956897c57a6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.220120:0:14440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58400/0xc3296956897c57a6 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.220126:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58400/0xc3296956897c57a6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.220133:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac58400 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919258.220137:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58400/0xc3296956897c57a6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.220144:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58400/0xc3296956897c57a6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.220155:0:14440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88be88e22300) 00010000:00010000:2.0:1790919258.220158:0:14440:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919258.220162:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58400/0xc3296956897c57a6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.220167:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58400/0xc3296956897c57a6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790919258.220182:0:14440:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b7c2bacc reply state 000000006463f335 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e000/0xc3296956897c57ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919258.220191:0:14440:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790919258.220232:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59c00/0xc3296956897c579f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d09d expref: 14 pid: 14440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.220258:0:14440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c57b4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d09d expref: 13 pid: 14440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.220266:0:14440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88be8b621400) 00010000:00010000:2.0:1790919258.220268:0:14440:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1790919258.220270:0:14440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be88386c00, rc 0) 00000100:00100000:2.0:1790919258.220617:0:14440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a397f618-6104-4fd0-addb-afcbd50d641f+14:14406:x1877914532564480:12345-192.168.201.27@tcp:101:bash.0 Request processed in 11923us (12182us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1790919258.220627:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 28 00010000:00010000:0.0:1790919258.225279:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e000/0xc3296956897c57ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.225297:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e000/0xc3296956897c57ad lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.225305:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e000/0xc3296956897c57ad lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.225312:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be90f9e000 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919258.225317:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e000/0xc3296956897c57ad lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.225325:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e000/0xc3296956897c57ad lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.225352:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff88be88e22900) 00010000:00010000:0.0:1790919258.225356:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919258.225360:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e000/0xc3296956897c57ad lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.225366:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e000/0xc3296956897c57ad lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919258.232377:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919258.232469:0:15856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532564736 00000100:00100000:1.0:1790919258.232480:0:15856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532564736 00000100:00100000:1.0:1790919258.232562:0:15856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 29 00000100:00100000:1.0:1790919258.232572:0:15856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a397f618-6104-4fd0-addb-afcbd50d641f+13:14406:x1877914532564736:12345-192.168.201.27@tcp:101:bash.0 00010000:00010000:1.0:1790919258.232597:0:15856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919258.232617:0:15856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516800/0xc3296956897c57c2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672d0a4 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919258.232674:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c57c9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919258.232687:0:15856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c57c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919258.232698:0:15856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c57c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790919258.232753:0:15856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1790919258.232765:0:15856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790919258.232783:0:15856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c57c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919258.232791:0:15856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c57c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919258.232808:0:15856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516800/0xc3296956897c57c2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0a4 expref: 15 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919258.232822:0:15856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c57c9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0a4 expref: 14 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919258.232828:0:15856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88be8b621400) 00010000:00010000:1.0:1790919258.232829:0:15856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790919258.232832:0:15856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81516600, rc 0) 00000100:00100000:1.0:1790919258.232880:0:15856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a397f618-6104-4fd0-addb-afcbd50d641f+14:14406:x1877914532564736:12345-192.168.201.27@tcp:101:bash.0 Request processed in 311us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919258.232885:0:15856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 29 00000100:00100000:1.0:1790919258.235414:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919258.235464:0:14443:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532564992 00000100:00100000:3.0:1790919258.235474:0:14443:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532564992 00000100:00100000:3.0:1790919258.235721:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 5 00000100:00100000:3.0:1790919258.235732:0:14443:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a397f618-6104-4fd0-addb-afcbd50d641f+14:14406:x1877914532564992:12345-192.168.201.27@tcp:35:bash.0 00000001:00080000:3.0:1790919258.236046:0:14443:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934601 00000100:00100000:3.0:1790919258.236160:0:14443:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a397f618-6104-4fd0-addb-afcbd50d641f+16:14406:x1877914532564992:12345-192.168.201.27@tcp:35:bash.0 Request processed in 429us (754us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1790919258.236169:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 5 00000020:00080000:3.0:1790919258.236174:0:14443:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:0.0:1790919258.251646:0:14472:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1790919258.349848:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919258.350006:0:14441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532565248 00000100:00100000:3.0:1790919258.350018:0:14441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532565248 00000100:00100000:3.0:1790919258.350320:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 30 00000100:00100000:3.0:1790919258.350333:0:14441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a397f618-6104-4fd0-addb-afcbd50d641f+16:14417:x1877914532565248:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:3.0:1790919258.350429:0:14441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919258.350450:0:14441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e200/0xc3296956897c57d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672d0ab expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919258.350610:0:14441:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1790919258.350729:0:14441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e200/0xc3296956897c57d0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0ab expref: 18 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.350741:0:14441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88be853b5b00) 00010000:00010000:3.0:1790919258.350744:0:14441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790919258.350748:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e200/0xc3296956897c57d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0ab expref: 18 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.350883:0:14441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be90f9e200, rc 0) 00000100:00100000:3.0:1790919258.351002:0:14441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a397f618-6104-4fd0-addb-afcbd50d641f+17:14417:x1877914532565248:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 672us (1164us total) trans 8589934603 rc 301/301 00000100:00100000:3.0:1790919258.351010:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 30 00000100:00100000:0.0:1790919258.359970:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919258.360078:0:14442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532565504 00000100:00100000:2.0:1790919258.360089:0:14442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532565504 00000100:00100000:2.0:1790919258.360152:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 6 00000100:00100000:2.0:1790919258.360164:0:14442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a397f618-6104-4fd0-addb-afcbd50d641f+17:14417:x1877914532565504:12345-192.168.201.27@tcp:35:lfs.0 00000100:00100000:2.0:1790919258.360585:0:14442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a397f618-6104-4fd0-addb-afcbd50d641f+18:14417:x1877914532565504:12345-192.168.201.27@tcp:35:lfs.0 Request processed in 422us (626us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1790919258.360593:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 6 00000100:00100000:1.0:1790919258.403000:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919258.403352:0:14439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532565760 00000100:00100000:3.0:1790919258.403363:0:14439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532565760 00000100:00100000:3.0:1790919258.403426:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 31 00000100:00100000:3.0:1790919258.403436:0:14439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a397f618-6104-4fd0-addb-afcbd50d641f+18:14420:x1877914532565760:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:3.0:1790919258.403460:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919258.403481:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e200/0xc3296956897c57de lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672d0b2 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.403608:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fa00/0xc3296956897c57e5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.403623:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fa00/0xc3296956897c57e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.403652:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fa00/0xc3296956897c57e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919258.403664:0:14439:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790919258.405011:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9e200/0xc3296956897c57de lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0b2 expref: 21 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.405208:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fa00/0xc3296956897c57e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0b2 expref: 20 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.405219:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88be8b621400) 00010000:00010000:2.0:1790919258.405222:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790919258.405237:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be90f9fa00, rc 0) 00000100:00100000:2.0:1790919258.405422:0:14439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a397f618-6104-4fd0-addb-afcbd50d641f+20:14420:x1877914532565760:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 1987us (2433us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1790919258.405431:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 31 00000100:00100000:0.0:1790919258.410735:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919258.410822:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919258.410939:0:14427:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532566016 00000100:00100000:1.0:1790919258.410949:0:14427:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532566016 00000100:00100000:1.0:1790919258.411024:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 0 00000100:00100000:1.0:1790919258.411037:0:14427:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a397f618-6104-4fd0-addb-afcbd50d641f+20:2353:x1877914532566016:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790919258.411064:0:14427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919258.411096:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fa00/0xc3296956897c57e5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0b2 expref: 20 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919258.411114:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88be8b621400) 00010000:00010000:1.0:1790919258.411118:0:14427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919258.411184:0:14427:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a397f618-6104-4fd0-addb-afcbd50d641f+19:2353:x1877914532566016:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 150us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919258.411191:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 0 00000100:00100000:2.0:1790919258.413014:0:14440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532565888 00000100:00100000:2.0:1790919258.413026:0:14440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532565888 00000100:00100000:2.0:1790919258.413187:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 32 00000100:00100000:2.0:1790919258.413199:0:14440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a397f618-6104-4fd0-addb-afcbd50d641f+19:14420:x1877914532565888:12345-192.168.201.27@tcp:54:lfs.0 00010000:00010000:2.0:1790919258.413266:0:14440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386800/0xc3296956897c57f3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.413283:0:14440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386800/0xc3296956897c57f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.413294:0:14440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386800/0xc3296956897c57f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.413334:0:14440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386800/0xc3296956897c57f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.413342:0:14440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386800/0xc3296956897c57f3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.413349:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386800/0xc3296956897c57f3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.413355:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386800 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919258.413360:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386800/0xc3296956897c57f3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.413368:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386800/0xc3296956897c57f3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.413394:0:14440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88be8b621400) 00010000:00010000:2.0:1790919258.413397:0:14440:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790919258.413402:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386800/0xc3296956897c57f3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.413408:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386800/0xc3296956897c57f3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919258.413485:0:14440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a397f618-6104-4fd0-addb-afcbd50d641f+19:14420:x1877914532565888:12345-192.168.201.27@tcp:54:lfs.0 Request processed in 289us (2759us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919258.413493:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 32 00000100:00100000:0.0:1790919258.420273:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919258.420783:0:14443:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532566272 00000100:00100000:3.0:1790919258.420797:0:14443:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532566272 00000100:00100000:3.0:1790919258.420883:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 7 00000100:00100000:3.0:1790919258.420895:0:14443:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a397f618-6104-4fd0-addb-afcbd50d641f+19:14420:x1877914532566272:12345-192.168.201.27@tcp:35:lfs.0 00000100:00100000:3.0:1790919258.421238:0:14443:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a397f618-6104-4fd0-addb-afcbd50d641f+20:14420:x1877914532566272:12345-192.168.201.27@tcp:35:lfs.0 Request processed in 344us (981us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1790919258.421247:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 7 00000100:00100000:0.0:1790919258.764475:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919258.764659:0:15856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532566528 00000100:00100000:1.0:1790919258.764676:0:15856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532566528 00000100:00100000:1.0:1790919258.764768:0:15856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 33 00000100:00100000:1.0:1790919258.764780:0:15856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a397f618-6104-4fd0-addb-afcbd50d641f+20:14451:x1877914532566528:12345-192.168.201.27@tcp:101:cat.0 00010000:00010000:1.0:1790919258.764816:0:15856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919258.764846:0:15856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517200/0xc3296956897c57fa lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672d0b9 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919258.764995:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517e00/0xc3296956897c5801 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919258.765014:0:15856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517e00/0xc3296956897c5801 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919258.765028:0:15856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517e00/0xc3296956897c5801 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790919258.765042:0:15856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1790919258.765422:0:15856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517200/0xc3296956897c57fa lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0b9 expref: 23 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919258.765469:0:15856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517e00/0xc3296956897c5801 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0b9 expref: 22 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919258.765478:0:15856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88be8b621400) 00010000:00010000:1.0:1790919258.765482:0:15856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790919258.765486:0:15856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81517e00, rc 0) 00000100:00100000:1.0:1790919258.765800:0:15856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a397f618-6104-4fd0-addb-afcbd50d641f+22:14451:x1877914532566528:12345-192.168.201.27@tcp:101:cat.0 Request processed in 1019us (1343us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1790919258.765811:0:15856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 33 00000100:00100000:0.0:1790919258.775021:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919258.775171:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919258.775359:0:14442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532566912 00000100:00100000:1.0:1790919258.775373:0:14442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532566912 00000100:00100000:1.0:1790919258.775445:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 8 00000100:00100000:1.0:1790919258.775457:0:14442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a397f618-6104-4fd0-addb-afcbd50d641f+22:14451:x1877914532566912:12345-192.168.201.27@tcp:35:cat.0 00000100:00100000:1.0:1790919258.775961:0:14442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a397f618-6104-4fd0-addb-afcbd50d641f+23:14451:x1877914532566912:12345-192.168.201.27@tcp:35:cat.0 Request processed in 504us (787us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1790919258.775970:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 8 00000100:00100000:2.0:1790919258.781779:0:16559:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532566656 00000100:00100000:2.0:1790919258.781802:0:16559:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532566656 00000100:00100000:2.0:1790919258.781924:0:16559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 1 00000100:00100000:2.0:1790919258.781937:0:16559:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a397f618-6104-4fd0-addb-afcbd50d641f+23:2353:x1877914532566656:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790919258.781960:0:16559:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919258.781996:0:16559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517e00/0xc3296956897c5801 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0b9 expref: 23 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.782023:0:16559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88be8b621400) 00010000:00010000:2.0:1790919258.782266:0:16559:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919258.782676:0:16559:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a397f618-6104-4fd0-addb-afcbd50d641f+22:2353:x1877914532566656:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 738us (7667us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919258.782687:0:16559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 1 00000100:00100000:0.0:1790919258.857434:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919258.857735:0:14441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532567168 00000100:00100000:3.0:1790919258.857750:0:14441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532567168 00000100:00100000:3.0:1790919258.857903:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 34 00000100:00100000:3.0:1790919258.857927:0:14441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a397f618-6104-4fd0-addb-afcbd50d641f+22:14457:x1877914532567168:12345-192.168.201.27@tcp:101:dd.0 00010000:00010000:3.0:1790919258.857962:0:14441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919258.857991:0:14441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ec00/0xc3296956897c580f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672d0c0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.860124:0:14441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c5816 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.860296:0:14441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c57b4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d09d expref: 23 pid: 14440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.860308:0:14441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c57c9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0a4 expref: 23 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.860346:0:14441:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c5816 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.860397:0:14441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c57c9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0a4 expref: 23 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.860420:0:14441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c57c9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0a4 expref: 23 pid: 15856 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919258.860440:0:14441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb35b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14441:1877914550380032:192.168.201.27@tcp:104: 00010000:00010000:3.0:1790919258.860619:0:14441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c57b4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672d09d expref: 23 pid: 14440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919258.860629:0:14441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c57b4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672d09d expref: 23 pid: 14440 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919258.860638:0:14441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb35b0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14441:1877914550380160:192.168.201.27@tcp:104: 00000100:00100000:3.0:1790919258.860662:0:14441:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb44eb180 going to sleep for 11 seconds 00000100:00100000:3.0:1790919258.866077:0:14441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb35b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14441:1877914550380032:192.168.201.27@tcp:104: 00000100:00100000:0.0:1790919258.866476:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919258.866516:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919258.866751:0:14441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb35b0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14441:1877914550380160:192.168.201.27@tcp:104: 00010000:00010000:3.0:1790919258.866786:0:14441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c5816 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919258.867367:0:14427:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532567296 00000100:00100000:1.0:1790919258.867379:0:14427:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532567296 00010000:00010000:1.0:1790919258.867432:0:14427:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c57c9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0a4 expref: 24 pid: 15856 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919258.867486:0:14427:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532567424 00000100:00100000:1.0:1790919258.867490:0:14427:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532567424 00010000:00010000:1.0:1790919258.867503:0:14427:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c57b4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672d09d expref: 25 pid: 14440 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919258.867902:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 11 00000100:00100000:1.0:1790919258.867926:0:14427:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be88de8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a397f618-6104-4fd0-addb-afcbd50d641f+25:2352:x1877914532567296:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790919258.867949:0:14427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919258.867957:0:14427:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c57c9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0a4 expref: 25 pid: 15856 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919258.867971:0:14427:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c57c9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0a4 expref: 25 pid: 15856 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919258.867999:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c57c9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0a4 expref: 25 pid: 15856 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919258.868021:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88be8b621400) 00010000:00010000:1.0:1790919258.868036:0:14427:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c5816 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919258.868048:0:14427:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c5816 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919258.868055:0:14427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919258.868130:0:14427:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be88de8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a397f618-6104-4fd0-addb-afcbd50d641f+24:2352:x1877914532567296:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 217us (1656us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919258.868138:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 11 00000100:00100000:1.0:1790919258.868211:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 12 00000100:00100000:1.0:1790919258.868219:0:14427:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a397f618-6104-4fd0-addb-afcbd50d641f+23:2352:x1877914532567424:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790919258.868237:0:14427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919258.868243:0:14427:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c57b4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672d09d expref: 23 pid: 14440 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919258.868253:0:14427:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c57b4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672d09d expref: 23 pid: 14440 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919258.868267:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386c00/0xc3296956897c57b4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672d09d expref: 23 pid: 14440 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919258.868278:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88be8b621400) 00010000:00010000:1.0:1790919258.868282:0:14427:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c5816 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919258.868291:0:14427:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c5816 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919258.868300:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c5816 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919258.868332:0:14427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919258.868353:0:14427:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a397f618-6104-4fd0-addb-afcbd50d641f+22:2352:x1877914532567424:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 135us (1836us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919258.868360:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 12 00010000:00010000:2.0:1790919258.877565:0:14441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c5816 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.880992:0:14441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c5816 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919258.881074:0:14441:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790919258.882934:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ec00/0xc3296956897c580f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0c0 expref: 23 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.882972:0:14441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9ee00/0xc3296956897c5816 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0c0 expref: 22 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.882984:0:14441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88be8b621400) 00010000:00010000:2.0:1790919258.882987:0:14441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790919258.882991:0:14441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be90f9ee00, rc 0) 00000100:00100000:2.0:1790919258.890338:0:14441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a397f618-6104-4fd0-addb-afcbd50d641f+22:14457:x1877914532567168:12345-192.168.201.27@tcp:101:dd.0 Request processed in 32404us (32901us total) trans 8589934609 rc 0/0 00000100:00100000:2.0:1790919258.890359:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 34 00000100:00100000:3.0:1790919258.899519:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919258.899652:0:14439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532567680 00000100:00100000:2.0:1790919258.899667:0:14439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532567680 00000100:00100000:2.0:1790919258.899756:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 35 00000100:00100000:2.0:1790919258.899769:0:14439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a397f618-6104-4fd0-addb-afcbd50d641f+22:14457:x1877914532567680:12345-192.168.201.27@tcp:36:dd.0 00010000:00010000:2.0:1790919258.900659:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386800/0xc3296956897c5824 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.900688:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386800/0xc3296956897c5824 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.900702:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386800/0xc3296956897c5824 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790919258.900768:0:14439:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934610 00000004:00010000:2.0:1790919258.901253:0:14439:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006abdece5 reply state 0000000050204c0f transno 8589934611 ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386800/0xc3296956897c5824 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919258.901265:0:14439:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790919258.901484:0:14439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a397f618-6104-4fd0-addb-afcbd50d641f+25:14457:x1877914532567680:12345-192.168.201.27@tcp:36:dd.0 Request processed in 1714us (1977us total) trans 8589934611 rc 0/0 00000100:00100000:2.0:1790919258.901494:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 35 00000020:00080000:2.0:1790919258.901501:0:14439:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790919258.909554:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386800/0xc3296956897c5824 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.909576:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386800/0xc3296956897c5824 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.909585:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386800/0xc3296956897c5824 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.909592:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386800 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919258.909597:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386800/0xc3296956897c5824 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.909606:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386800/0xc3296956897c5824 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.909626:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88be8b621400) 00010000:00010000:0.0:1790919258.909630:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919258.909636:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386800/0xc3296956897c5824 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919258.909641:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386800/0xc3296956897c5824 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919258.910951:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919258.911179:0:14440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532567808 00000100:00100000:2.0:1790919258.911195:0:14440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532567808 00000100:00100000:2.0:1790919258.911271:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 36 00000100:00100000:2.0:1790919258.911283:0:14440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a397f618-6104-4fd0-addb-afcbd50d641f+24:14457:x1877914532567808:12345-192.168.201.27@tcp:101:dd.0 00010000:00010000:2.0:1790919258.911324:0:14440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919258.911356:0:14440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c582b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672d0c7 expref: -99 pid: 14440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.911445:0:14440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c582b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0c7 expref: 25 pid: 14440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.911463:0:14440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c582b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0c7 expref: 25 pid: 14440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.911488:0:14440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88be8b621400) 00010000:00010000:2.0:1790919258.911492:0:14440:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790919258.911496:0:14440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be88387a00, rc 0) 00000100:00100000:2.0:1790919258.911613:0:14440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a397f618-6104-4fd0-addb-afcbd50d641f+25:14457:x1877914532567808:12345-192.168.201.27@tcp:101:dd.0 Request processed in 332us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919258.911622:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 36 00000100:00100000:3.0:1790919258.975360:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919258.975992:0:14426:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532568064 00000100:00100000:2.0:1790919258.976006:0:14426:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532568064 00000100:00100000:2.0:1790919258.976096:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 2 00000100:00100000:2.0:1790919258.976108:0:14426:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a397f618-6104-4fd0-addb-afcbd50d641f+25:14457:x1877914532568064:12345-192.168.201.27@tcp:103:dd.0 00010000:00010000:2.0:1790919258.976129:0:14426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919258.976176:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c582b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0c7 expref: 25 pid: 14440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.976203:0:14426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88be8b621400) 00010000:00010000:2.0:1790919258.976210:0:14426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919258.976305:0:14426:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a397f618-6104-4fd0-addb-afcbd50d641f+24:14457:x1877914532568064:12345-192.168.201.27@tcp:103:dd.0 Request processed in 199us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919258.976314:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 2 00000100:00100000:1.0:1790919258.980370:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919258.980575:0:15856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532568192 00000100:00100000:3.0:1790919258.980593:0:15856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532568192 00000100:00100000:2.0:1790919258.980776:0:15856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 37 00000100:00100000:2.0:1790919258.980788:0:15856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a397f618-6104-4fd0-addb-afcbd50d641f+24:14457:x1877914532568192:12345-192.168.201.27@tcp:58:dd.0 00010000:00010000:2.0:1790919258.980905:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c5832 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.980935:0:15856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c5832 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919258.980946:0:15856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c5832 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790919258.982904:0:15856:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790919258.983726:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1790919258.983901:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1790919258.988020:0:15856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a397f618-6104-4fd0-addb-afcbd50d641f+24:14457:x1877914532568192:12345-192.168.201.27@tcp:58:dd.0 Request processed in 4532us (4966us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919258.988064:0:15856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 37 00000100:00100000:0.0:1790919259.001094:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919259.001230:0:14440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532568320 00000100:00100000:2.0:1790919259.001249:0:14440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532568320 00000100:00100000:2.0:1790919259.001350:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 38 00000100:00100000:2.0:1790919259.001365:0:14440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a397f618-6104-4fd0-addb-afcbd50d641f+24:14457:x1877914532568320:12345-192.168.201.27@tcp:101:dd.0 00010000:00010000:2.0:1790919259.001390:0:14440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919259.001414:0:14440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c5839 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672d0ce expref: -99 pid: 14440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.001473:0:14440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c5832 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.001485:0:14440:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c5839 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0ce expref: 25 pid: 14440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.001508:0:14440:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c5832 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.001523:0:14440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c5839 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0ce expref: 25 pid: 14440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.001577:0:14440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88be8b621400) 00010000:00010000:2.0:1790919259.001581:0:14440:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790919259.001585:0:14440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c5839 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0ce expref: 25 pid: 14440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.001592:0:14440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be88387a00, rc 0) 00000100:00100000:0.0:1790919259.001758:0:14440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a397f618-6104-4fd0-addb-afcbd50d641f+25:14457:x1877914532568320:12345-192.168.201.27@tcp:101:dd.0 Request processed in 393us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919259.001770:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 38 00000100:00080000:3.0:1790919259.001923:0:14435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790919259.008562:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790919259.265270:0:14472:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1790919259.265286:0:14472:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790919259.265345:0:14472:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1790919259.265360:0:14472:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1790919259.266683:0:14472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb0b1dc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14472:1877914550380288:192.168.201.27@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790919259.266896:0:14472:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bebbe2a480 going to sleep for 11 seconds 00000100:00100000:0.0:1790919259.278141:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919259.278358:0:14472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb0b1dc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14472:1877914550380288:192.168.201.27@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790919259.283292:0:14450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532568448 00000100:00100000:1.0:1790919259.283319:0:14450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532568448 00000100:00100000:1.0:1790919259.283423:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 0 00000100:00100000:1.0:1790919259.283436:0:14450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a397f618-6104-4fd0-addb-afcbd50d641f+25:14458:x1877914532568448:12345-192.168.201.27@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1790919259.283618:0:14450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a397f618-6104-4fd0-addb-afcbd50d641f+25:14458:x1877914532568448:12345-192.168.201.27@tcp:900:lhsmtool_posix.0 Request processed in 183us (5492us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919259.283627:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 0 00000100:00100000:3.0:1790919259.288658:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919259.296405:0:15856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532568576 00000100:00100000:2.0:1790919259.296431:0:15856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532568576 00000100:00100000:2.0:1790919259.296563:0:15856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 39 00000100:00100000:2.0:1790919259.296577:0:15856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a397f618-6104-4fd0-addb-afcbd50d641f+25:14458:x1877914532568576:12345-192.168.201.27@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790919259.296624:0:15856:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790919259.296935:0:15856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a397f618-6104-4fd0-addb-afcbd50d641f+25:14458:x1877914532568576:12345-192.168.201.27@tcp:53:lhsmtool_posix.0 Request processed in 359us (8293us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919259.297007:0:15856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 39 00000100:00100000:2.0:1790919259.306262:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919259.306438:0:14441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532568704 00000100:00100000:0.0:1790919259.306452:0:14441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532568704 00000100:00100000:0.0:1790919259.306571:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 40 00000100:00100000:0.0:1790919259.306582:0:14441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a397f618-6104-4fd0-addb-afcbd50d641f+25:14458:x1877914532568704:12345-192.168.201.27@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1790919259.306697:0:14441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c5840 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919259.306720:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c5840 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919259.306738:0:14441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c5840 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919259.306757:0:14441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58800/0xc3296956897c5847 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919259.306764:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58800/0xc3296956897c5847 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919259.306771:0:14441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58800/0xc3296956897c5847 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919259.307006:0:14441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c584e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919259.307036:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c584e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919259.307044:0:14441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c584e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919259.307098:0:14441:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1790919259.307102:0:14441:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790919259.307119:0:14441:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c584e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919259.307132:0:14441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c5840 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919259.307140:0:14441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c5840 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919259.307216:0:14441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c5840 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919259.307223:0:14441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac59800 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919259.307228:0:14441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c5840 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919259.307237:0:14441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c5840 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919259.307251:0:14441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88be88e22600) 00010000:00010000:0.0:1790919259.307261:0:14441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919259.307268:0:14441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c5840 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919259.307275:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac59800/0xc3296956897c5840 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919259.307292:0:14441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58800/0xc3296956897c5847 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919259.307298:0:14441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58800/0xc3296956897c5847 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919259.307305:0:14441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58800/0xc3296956897c5847 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919259.307310:0:14441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac58800 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919259.307312:0:14441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58800/0xc3296956897c5847 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919259.307318:0:14441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58800/0xc3296956897c5847 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919259.307324:0:14441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff88be853b5f00) 00010000:00010000:0.0:1790919259.307326:0:14441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919259.307328:0:14441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58800/0xc3296956897c5847 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919259.307334:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58800/0xc3296956897c5847 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919259.307350:0:14441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c584e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919259.307360:0:14441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c584e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919259.307366:0:14441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c584e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919259.307371:0:14441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac58a00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919259.307373:0:14441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c584e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919259.307379:0:14441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c584e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919259.307385:0:14441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88be8b621400) 00010000:00010000:0.0:1790919259.307387:0:14441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919259.309091:0:14441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c584e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919259.309118:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c584e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919259.309276:0:14441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a397f618-6104-4fd0-addb-afcbd50d641f+25:14458:x1877914532568704:12345-192.168.201.27@tcp:34:lhsmtool_posix.0 Request processed in 2690us (3021us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919259.309287:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 40 00000100:00100000:0.0:1790919259.327596:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919259.327706:0:15856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532568960 00000100:00100000:2.0:1790919259.327723:0:15856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532568960 00000100:00100000:2.0:1790919259.327825:0:15856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 41 00000100:00100000:2.0:1790919259.327839:0:15856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a397f618-6104-4fd0-addb-afcbd50d641f+25:14458:x1877914532568960:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790919259.327872:0:15856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919259.327900:0:15856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c5855 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672d0d5 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.328317:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387600/0xc3296956897c585c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.328338:0:15856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387600/0xc3296956897c585c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.328353:0:15856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387600/0xc3296956897c585c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919259.328368:0:15856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790919259.330054:0:15856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387600/0xc3296956897c585c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.330104:0:15856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387600/0xc3296956897c585c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.330112:0:15856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387600/0xc3296956897c585c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.330119:0:15856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88387600 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919259.330125:0:15856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387600/0xc3296956897c585c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.330134:0:15856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387600/0xc3296956897c585c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.331297:0:15856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88be8b621400) 00010000:00010000:2.0:1790919259.331308:0:15856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790919259.331317:0:15856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387600/0xc3296956897c585c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.331330:0:15856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387600/0xc3296956897c585c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.332731:0:15856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c5855 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0d5 expref: 27 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.332756:0:15856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88be88e22600) 00010000:00010000:2.0:1790919259.332759:0:15856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790919259.332764:0:15856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c5855 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0d5 expref: 27 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.332784:0:15856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be88387200, rc 0) 00000100:00100000:2.0:1790919259.333965:0:15856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a397f618-6104-4fd0-addb-afcbd50d641f+26:14458:x1877914532568960:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 6108us (6358us total) trans 8589934612 rc 301/301 00000100:00100000:2.0:1790919259.333980:0:15856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 41 00000100:00100000:3.0:1790919259.345095:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919259.345298:0:14440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532569088 00000100:00100000:2.0:1790919259.345312:0:14440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532569088 00000100:00100000:2.0:1790919259.345386:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 42 00000100:00100000:2.0:1790919259.345414:0:14440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a397f618-6104-4fd0-addb-afcbd50d641f+26:14458:x1877914532569088:12345-192.168.201.27@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790919259.345486:0:14440:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790919259.345684:0:14440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a397f618-6104-4fd0-addb-afcbd50d641f+26:14458:x1877914532569088:12345-192.168.201.27@tcp:53:lhsmtool_posix.0 Request processed in 272us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919259.345693:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 42 00000100:00100000:3.0:1790919259.353210:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919259.353384:0:14439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532569344 00000100:00100000:1.0:1790919259.353395:0:14439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532569344 00000100:00100000:1.0:1790919259.353477:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 43 00000100:00100000:1.0:1790919259.353489:0:14439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a397f618-6104-4fd0-addb-afcbd50d641f+26:14458:x1877914532569344:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790919259.353509:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919259.353575:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517e00/0xc3296956897c586a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672d0dc expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790919259.354230:0:14439:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:1.0:1790919259.354238:0:14439:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:1.0:1790919259.354286:0:14439:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:1.0:1790919259.354564:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516800/0xc3296956897c5871 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919259.354580:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516800/0xc3296956897c5871 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919259.354591:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516800/0xc3296956897c5871 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919259.354643:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517e00/0xc3296956897c586a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0dc expref: 29 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919259.354661:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516800/0xc3296956897c5871 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0dc expref: 28 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919259.354681:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88be86130500) 00010000:00010000:1.0:1790919259.354684:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790919259.354688:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81516800, rc 0) 00000100:00100000:1.0:1790919259.354757:0:14439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a397f618-6104-4fd0-addb-afcbd50d641f+28:14458:x1877914532569344:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 1270us (1557us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1790919259.354765:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 43 00000100:00100000:1.0:1790919259.357949:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919259.358159:0:14440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532569600 00000100:00100000:2.0:1790919259.358180:0:14440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532569600 00000100:00100000:2.0:1790919259.358283:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 44 00000100:00100000:2.0:1790919259.358296:0:14440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a397f618-6104-4fd0-addb-afcbd50d641f+28:14458:x1877914532569600:12345-192.168.201.27@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790919259.358378:0:14440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919259.358424:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516800/0xc3296956897c5871 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0dc expref: 28 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.358451:0:14440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88be86130500) 00010000:00010000:2.0:1790919259.358475:0:14440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790919259.358507:0:14440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c587f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.358524:0:14440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c587f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.358587:0:14440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c587f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.363606:0:14440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387600/0xc3296956897c5886 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x58b93a0a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.363633:0:14440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387600/0xc3296956897c5886 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x58b93a0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.363646:0:14440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387600/0xc3296956897c5886 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x58b93a0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.363730:0:14440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c587f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.363738:0:14440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c587f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.363745:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c587f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.363751:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88387200 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919259.363755:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c587f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.363763:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c587f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.363775:0:14440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88be88e22300) 00010000:00010000:2.0:1790919259.363778:0:14440:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919259.363783:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c587f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.363789:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c587f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.363818:0:14440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387600/0xc3296956897c5886 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x58b93a0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.363824:0:14440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387600/0xc3296956897c5886 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x58b93a0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.363830:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387600/0xc3296956897c5886 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x58b93a0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.363836:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88387600 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:2.0:1790919259.363839:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387600/0xc3296956897c5886 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x58b93a0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.363846:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387600/0xc3296956897c5886 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x58b93a0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.365307:0:14440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x58b93a0a (ffff88be8b621d00) 00010000:00010000:2.0:1790919259.365312:0:14440:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919259.365318:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387600/0xc3296956897c5886 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x58b93a0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.365326:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387600/0xc3296956897c5886 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x58b93a0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919259.365471:0:14440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a397f618-6104-4fd0-addb-afcbd50d641f+27:14458:x1877914532569600:12345-192.168.201.27@tcp:36:lhsmtool_posix.0 Request processed in 7173us (7525us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790919259.365481:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 44 00000100:00100000:0.0:1790919259.368192:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919259.368385:0:15856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532569728 00000100:00100000:2.0:1790919259.368398:0:15856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532569728 00000100:00100000:2.0:1790919259.368464:0:15856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 45 00000100:00100000:2.0:1790919259.368490:0:15856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb0b1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a397f618-6104-4fd0-addb-afcbd50d641f+27:14458:x1877914532569728:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790919259.368510:0:15856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919259.368666:0:15856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c588d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672d0e3 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.368712:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386400/0xc3296956897c5894 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.368726:0:15856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386400/0xc3296956897c5894 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.368739:0:15856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386400/0xc3296956897c5894 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.368841:0:15856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c588d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0e3 expref: 29 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.368874:0:15856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386400/0xc3296956897c5894 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0e3 expref: 28 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.368883:0:15856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88be8b621a00) 00010000:00010000:2.0:1790919259.368886:0:15856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790919259.368889:0:15856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be88386400, rc 0) 00000100:00100000:2.0:1790919259.368973:0:15856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb0b1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a397f618-6104-4fd0-addb-afcbd50d641f+28:14458:x1877914532569728:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 476us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919259.368981:0:15856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 45 00000100:00100000:3.0:1790919259.379576:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919259.379953:0:14441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532569984 00000100:00100000:0.0:1790919259.379963:0:14441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532569984 00000100:00100000:0.0:1790919259.380032:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 46 00000100:00100000:0.0:1790919259.380042:0:14441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a397f618-6104-4fd0-addb-afcbd50d641f+28:14458:x1877914532569984:12345-192.168.201.27@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790919259.380139:0:14441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c589b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919259.380156:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c589b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919259.380167:0:14441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c589b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790919259.380724:0:14441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1790919259.380734:0:14441:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 461269207398ns, next at 462269204999ns, rc = 0 00000004:00010000:0.0:1790919259.380815:0:14441:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000eb2c4deb reply state 000000009a896ca5 transno 8589934614 ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c589b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919259.380825:0:14441:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790919259.381030:0:14441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a397f618-6104-4fd0-addb-afcbd50d641f+30:14458:x1877914532569984:12345-192.168.201.27@tcp:36:lhsmtool_posix.0 Request processed in 986us (1506us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1790919259.381040:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 46 00000100:00100000:1.0:1790919259.388926:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00010000:00010000:0.0:1790919259.389043:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c589b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919259.389048:0:14439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532570112 00010000:00010000:0.0:1790919259.389058:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c589b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919259.389060:0:14439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532570112 00010000:00010000:0.0:1790919259.389076:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c589b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919259.389082:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac58a00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:0.0:1790919259.389087:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c589b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919259.389119:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c589b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919259.389127:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 47 00010000:00010000:0.0:1790919259.389146:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88be8b621a00) 00000100:00100000:2.0:1790919259.389151:0:14439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a397f618-6104-4fd0-addb-afcbd50d641f+30:14458:x1877914532570112:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790919259.389152:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790919259.389159:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c589b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919259.389166:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88bebac58a00/0xc3296956897c589b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.389182:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919259.389200:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c58a2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672d0ea expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.389275:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c58a2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0ea expref: 30 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.389289:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c58a2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0ea expref: 30 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.389307:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88be8b621a00) 00010000:00010000:2.0:1790919259.389310:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790919259.389313:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be88386200, rc 0) 00000100:00100000:2.0:1790919259.389376:0:14439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a397f618-6104-4fd0-addb-afcbd50d641f+30:14458:x1877914532570112:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 230us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919259.389384:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 47 00000100:00100000:3.0:1790919259.397476:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919259.397629:0:15124:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532570240 00000100:00100000:0.0:1790919259.397640:0:15124:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532570240 00000100:00100000:0.0:1790919259.397729:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 13 00000100:00100000:0.0:1790919259.397739:0:15124:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a397f618-6104-4fd0-addb-afcbd50d641f+5:2352:x1877914532570240:12345-192.168.201.27@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1790919259.398415:0:15124:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a397f618-6104-4fd0-addb-afcbd50d641f+6:2352:x1877914532570240:12345-192.168.201.27@tcp:2:lhsmtool_posix.0 Request processed in 674us (945us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1790919259.398425:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 13 00000100:00080000:3.0:1790919259.398869:0:14435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790919259.402233:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919259.402405:0:14442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532570496 00000100:00100000:2.0:1790919259.402416:0:14442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532570496 00000100:00100000:2.0:1790919259.402477:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 9 00000100:00100000:2.0:1790919259.402487:0:14442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a397f618-6104-4fd0-addb-afcbd50d641f+30:14458:x1877914532570496:12345-192.168.201.27@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790919259.402761:0:14442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a397f618-6104-4fd0-addb-afcbd50d641f+31:14458:x1877914532570496:12345-192.168.201.27@tcp:35:lhsmtool_posix.0 Request processed in 273us (535us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1790919259.402768:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 9 00000100:00100000:2.0:1790919259.405757:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919259.405835:0:14441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532570752 00000100:00100000:0.0:1790919259.405845:0:14441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532570752 00000100:00100000:0.0:1790919259.405900:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 48 00000100:00100000:0.0:1790919259.405920:0:14441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a397f618-6104-4fd0-addb-afcbd50d641f+31:14458:x1877914532570752:12345-192.168.201.27@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790919259.406032:0:14441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a397f618-6104-4fd0-addb-afcbd50d641f+31:14458:x1877914532570752:12345-192.168.201.27@tcp:57:lhsmtool_posix.0 Request processed in 111us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919259.406040:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 48 00000100:00100000:0.0:1790919259.413085:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919259.413357:0:14439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532570880 00000100:00100000:2.0:1790919259.413383:0:14439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532570880 00000100:00100000:2.0:1790919259.413448:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 49 00000100:00100000:2.0:1790919259.413459:0:14439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba03f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a397f618-6104-4fd0-addb-afcbd50d641f+31:14458:x1877914532570880:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790919259.413485:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919259.413508:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387600/0xc3296956897c58a9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672d0f1 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.413611:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c58b0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.413626:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c58b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.413637:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c58b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919259.413687:0:14439:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790919259.413707:0:14439:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c58b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.413733:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387600/0xc3296956897c58a9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0f1 expref: 33 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.413750:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c58b0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0f1 expref: 32 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.413758:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88be8b621a00) 00010000:00010000:2.0:1790919259.413761:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790919259.413764:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be88387200, rc 0) 00000100:00100000:2.0:1790919259.413820:0:14439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba03f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a397f618-6104-4fd0-addb-afcbd50d641f+32:14458:x1877914532570880:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 363us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919259.413833:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 49 00000100:00100000:3.0:1790919259.417786:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919259.417939:0:15125:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532571008 00000100:00100000:1.0:1790919259.417950:0:15125:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532571008 00000100:00100000:1.0:1790919259.418004:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 14 00000100:00100000:1.0:1790919259.418015:0:15125:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a397f618-6104-4fd0-addb-afcbd50d641f+6:2353:x1877914532571008:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790919259.418042:0:15125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919259.418076:0:15125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053d7ba22/0xc3296956897c58b7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672d0f8 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790919259.418114:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abf425c, blocks: 0x1 00010000:00010000:1.0:1790919259.418142:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1790919259.418147:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919259.418156:0:15125:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053d7ba22/0xc3296956897c58b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0f8 expref: 7 pid: 15125 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919259.418174:0:15125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000053d7ba22/0xc3296956897c58b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0f8 expref: 7 pid: 15125 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919259.418205:0:15125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be81516800, rc 0) 00000100:00100000:1.0:1790919259.418271:0:15125:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a397f618-6104-4fd0-addb-afcbd50d641f+7:2353:x1877914532571008:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 258us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919259.418277:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 14 00000100:00100000:0.0:1790919259.422338:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919259.422461:0:14441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532571264 00000100:00100000:3.0:1790919259.422471:0:14441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532571264 00000100:00100000:3.0:1790919259.422561:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 50 00000100:00100000:3.0:1790919259.422572:0:14441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba03e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a397f618-6104-4fd0-addb-afcbd50d641f+32:14458:x1877914532571264:12345-192.168.201.27@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790919259.423645:0:14441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba03e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a397f618-6104-4fd0-addb-afcbd50d641f+32:14458:x1877914532571264:12345-192.168.201.27@tcp:57:lhsmtool_posix.0 Request processed in 1068us (1310us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919259.423665:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 50 00000100:00100000:2.0:1790919259.427337:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919259.427446:0:14439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532571392 00000100:00100000:1.0:1790919259.427455:0:14439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532571392 00000100:00100000:1.0:1790919259.427558:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 51 00000100:00100000:1.0:1790919259.427569:0:14439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebf74d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a397f618-6104-4fd0-addb-afcbd50d641f+32:14458:x1877914532571392:12345-192.168.201.27@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1790919259.499010:0:5869:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1790919259.499030:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1790919259.499043:0:5869:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934595 is committed 00000100:00100000:1.0:1790919259.499416:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790919259.499442:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb3b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550380416:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1790919259.499522:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:1.0:1790919259.499621:0:5869:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934615 is committed 00000001:00080000:1.0:1790919259.499642:0:5869:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:1.0:1790919259.499742:0:5869:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:1.0:1790919259.499766:0:16672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550380416 00000100:00100000:1.0:1790919259.499773:0:16672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550380416 00000100:00100000:1.0:1790919259.499826:0:16672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790919259.499834:0:16672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1877914550380416:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1790919259.500006:0:16672:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1790919259.500010:0:16672:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1790919259.500012:0:16672:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1790919259.500014:0:16672:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1790919260 -> 1790919260 00002000:00010000:1.0:1790919259.500522:0:16672:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1790919259.500591:0:16672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1877914550380416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 757us (1068us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1790919259.500599:0:16672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790919259.500763:0:14439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebf74d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a397f618-6104-4fd0-addb-afcbd50d641f+14:14458:x1877914532571392:12345-192.168.201.27@tcp:44:lhsmtool_posix.0 Request processed in 73194us (73432us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919259.500772:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 51 00000100:00080000:2.0:1790919259.503045:0:14435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1790919259.503810:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88beb3b39500/2, rc 0, transno 8589934595 00000100:00100000:0.0:1790919259.503821:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb3b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1877914550380416:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1790919259.505280:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919259.505442:0:15125:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532571520 00000100:00100000:1.0:1790919259.505452:0:15125:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532571520 00000100:00100000:1.0:1790919259.505503:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 16 00000100:00100000:1.0:1790919259.505513:0:15125:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a397f618-6104-4fd0-addb-afcbd50d641f+7:2353:x1877914532571520:12345-192.168.201.27@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1790919259.505641:0:15125:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a397f618-6104-4fd0-addb-afcbd50d641f+7:2353:x1877914532571520:12345-192.168.201.27@tcp:16:lhsmtool_posix.0 Request processed in 129us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919259.505658:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 16 00000100:00100000:1.0:1790919259.509856:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919259.510014:0:14440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532571776 00000100:00100000:2.0:1790919259.510244:0:14440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532571776 00000100:00100000:2.0:1790919259.510422:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 52 00000100:00100000:2.0:1790919259.510433:0:14440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a397f618-6104-4fd0-addb-afcbd50d641f+14:14458:x1877914532571776:12345-192.168.201.27@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790919259.510487:0:14440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919259.510514:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387200/0xc3296956897c58b0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0f1 expref: 14 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.510558:0:14440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88be8b621a00) 00010000:00010000:2.0:1790919259.510563:0:14440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790919259.510593:0:14440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387600/0xc3296956897c58be lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.510608:0:14440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387600/0xc3296956897c58be lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.510618:0:14440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387600/0xc3296956897c58be lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790919259.510845:0:14440:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a22134c1 reply state 0000000004ccdfbe transno 8589934616 ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387600/0xc3296956897c58be lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919259.510855:0:14440:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790919259.510978:0:14440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a397f618-6104-4fd0-addb-afcbd50d641f+15:14458:x1877914532571776:12345-192.168.201.27@tcp:36:lhsmtool_posix.0 Request processed in 547us (1130us total) trans 8589934616 rc 0/0 00000100:00100000:2.0:1790919259.510985:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 52 00000100:00100000:3.0:1790919259.514268:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919259.514301:0:15124:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532571904 00000100:00100000:3.0:1790919259.514310:0:15124:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532571904 00010000:00010000:1.0:1790919259.514752:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387600/0xc3296956897c58be lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919259.514764:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387600/0xc3296956897c58be lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919259.514772:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387600/0xc3296956897c58be lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919259.514778:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88387600 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:1.0:1790919259.514782:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387600/0xc3296956897c58be lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919259.514790:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387600/0xc3296956897c58be lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919259.514805:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88be8b621a00) 00010000:00010000:1.0:1790919259.514822:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919259.514827:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387600/0xc3296956897c58be lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919259.514832:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387600/0xc3296956897c58be lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919259.515106:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 17 00000100:00100000:3.0:1790919259.515116:0:15124:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a397f618-6104-4fd0-addb-afcbd50d641f+7:14458:x1877914532571904:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790919259.515274:0:15124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919259.515294:0:15124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7362843/0xc3296956897c58c5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf8b413717672d0ff expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919259.515679:0:15124:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000053d7ba22/0xc3296956897c58b7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0f8 expref: 8 pid: 15125 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919259.515697:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919259.515701:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919259.515708:0:15124:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7362843/0xc3296956897c58c5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0ff expref: 8 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919259.515745:0:15124:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000053d7ba22/0xc3296956897c58b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0f8 expref: 8 pid: 15125 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919259.515759:0:15124:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000053d7ba22/0xc3296956897c58b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0f8 expref: 8 pid: 15125 timeout: 561 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919259.515775:0:15124:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb35b2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15124:1877914550380544:192.168.201.27@tcp:104: 00000100:00100000:3.0:1790919259.515892:0:15124:0:(client.c:2716:ptlrpc_set_wait()) set ffff88beb44eb180 going to sleep for 11 seconds 00000100:00100000:3.0:1790919259.531436:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919259.531493:0:15124:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb35b2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15124:1877914550380544:192.168.201.27@tcp:104: 00010000:00010000:3.0:1790919259.531539:0:15124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b7362843/0xc3296956897c58c5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0ff expref: 8 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919259.531557:0:15124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88be90f9fa00, rc 0) 00000100:00100000:3.0:1790919259.531603:0:15124:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a397f618-6104-4fd0-addb-afcbd50d641f+8:14458:x1877914532571904:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 16489us (17345us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919259.531612:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 17 00000100:00100000:3.0:1790919259.533480:0:14427:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532572032 00000100:00100000:3.0:1790919259.533550:0:14427:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532572032 00010000:00010000:3.0:1790919259.533602:0:14427:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000053d7ba22/0xc3296956897c58b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0f8 expref: 8 pid: 15125 timeout: 561 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919259.533876:0:16559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 13 00000100:00100000:0.0:1790919259.533890:0:16559:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a397f618-6104-4fd0-addb-afcbd50d641f+8:2353:x1877914532572032:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790919259.533917:0:16559:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919259.533942:0:16559:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000053d7ba22/0xc3296956897c58b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0f8 expref: 8 pid: 15125 timeout: 561 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919259.533956:0:16559:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000053d7ba22/0xc3296956897c58b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0f8 expref: 8 pid: 15125 timeout: 561 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919259.533980:0:16559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053d7ba22/0xc3296956897c58b7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0f8 expref: 8 pid: 15125 timeout: 561 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919259.533997:0:16559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919259.534002:0:16559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919259.534009:0:16559:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b7362843/0xc3296956897c58c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0ff expref: 7 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919259.534031:0:16559:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7362843/0xc3296956897c58c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0ff expref: 7 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919259.534079:0:16559:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b7362843/0xc3296956897c58c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0ff expref: 7 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919259.534108:0:16559:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beba03d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:16559:1877914550380672:192.168.201.27@tcp:105: 00000100:00100000:0.0:1790919259.534191:0:16559:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be9f8a4780 going to sleep for 11 seconds 00000100:00100000:0.0:1790919259.538231:0:16559:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beba03d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:16559:1877914550380672:192.168.201.27@tcp:105: 00010000:00010000:0.0:1790919259.538258:0:16559:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919259.538323:0:16559:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a397f618-6104-4fd0-addb-afcbd50d641f+7:2353:x1877914532572032:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 4436us (6895us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919259.538334:0:16559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 13 00000100:00100000:3.0:1790919259.538714:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919259.539247:0:15125:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532572160 00000100:00100000:2.0:1790919259.539256:0:15125:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532572160 00000100:00100000:2.0:1790919259.539314:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 18 00000100:00100000:2.0:1790919259.539326:0:15125:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb35b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a397f618-6104-4fd0-addb-afcbd50d641f+7:2353:x1877914532572160:12345-192.168.201.27@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1790919259.539520:0:15125:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1790919259.539553:0:15125:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1790919259 00002000:00010000:2.0:1790919259.539556:0:15125:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1790919258 00002000:00010000:2.0:1790919259.539559:0:15125:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1790919260 -> 1790919259 00002000:00010000:2.0:1790919259.539561:0:15125:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1790919259.539599:0:15125:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb35b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a397f618-6104-4fd0-addb-afcbd50d641f+8:2353:x1877914532572160:12345-192.168.201.27@tcp:2:lhsmtool_posix.0 Request processed in 276us (886us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1790919259.539607:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 18 00000100:00100000:1.0:1790919259.545738:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1790919259.545829:0:16672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532572288 00000100:00100000:2.0:1790919259.545840:0:16672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532572288 00000100:00100000:2.0:1790919259.545935:0:16672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 19 00000100:00100000:2.0:1790919259.545945:0:16672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb3b3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a397f618-6104-4fd0-addb-afcbd50d641f+8:2353:x1877914532572288:12345-192.168.201.27@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1790919259.545988:0:16672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d9ee6862/0xc3296956897c58cc lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.546038:0:16672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b7362843/0xc3296956897c58c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0ff expref: 8 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.546046:0:16672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919259.546050:0:16672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790919259.546054:0:16672:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9ee6862/0xc3296956897c58cc lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.546099:0:16672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b7362843/0xc3296956897c58c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0ff expref: 8 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.546113:0:16672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b7362843/0xc3296956897c58c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0ff expref: 8 pid: 15124 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919259.546128:0:16672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb4265180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:16672:1877914550380800:192.168.201.27@tcp:104: 00000100:00100000:2.0:1790919259.546242:0:16672:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be84f6e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790919259.549409:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919259.549510:0:16672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb4265180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:16672:1877914550380800:192.168.201.27@tcp:104: 00010000:00010000:1.0:1790919259.549559:0:16672:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d9ee6862/0xc3296956897c58cc lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919259.549729:0:14426:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532572416 00000100:00100000:3.0:1790919259.549736:0:14426:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532572416 00010000:00010000:3.0:1790919259.549772:0:14426:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b7362843/0xc3296956897c58c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0ff expref: 9 pid: 15124 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919259.549836:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 14 00000100:00100000:3.0:1790919259.549845:0:14426:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4267b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a397f618-6104-4fd0-addb-afcbd50d641f+9:2353:x1877914532572416:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919259.549860:0:14426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919259.549881:0:14426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b7362843/0xc3296956897c58c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0ff expref: 9 pid: 15124 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919259.549893:0:14426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b7362843/0xc3296956897c58c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0ff expref: 9 pid: 15124 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919259.549924:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7362843/0xc3296956897c58c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0ff expref: 9 pid: 15124 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919259.549940:0:14426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790919259.549944:0:14426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790919259.549949:0:14426:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9ee6862/0xc3296956897c58cc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919259.549978:0:14426:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9ee6862/0xc3296956897c58cc lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919259.550008:0:14426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790919259.550153:0:16672:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d9ee6862/0xc3296956897c58cc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.550163:0:16672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9ee6862/0xc3296956897c58cc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.550186:0:16672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d9ee6862/0xc3296956897c58cc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.550201:0:16672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9ee6862/0xc3296956897c58cc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.550208:0:16672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9ee6862/0xc3296956897c58cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.550214:0:16672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88387000 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:2.0:1790919259.550219:0:16672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9ee6862/0xc3296956897c58cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.550228:0:16672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9ee6862/0xc3296956897c58cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.550239:0:16672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9ee6862/0xc3296956897c58cc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.550247:0:16672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9ee6862/0xc3296956897c58cc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919259.550318:0:16672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb3b3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a397f618-6104-4fd0-addb-afcbd50d641f+8:2353:x1877914532572288:12345-192.168.201.27@tcp:1:lhsmtool_posix.0 Request processed in 4374us (4589us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919259.550327:0:16672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 19 00000100:00100000:3.0:1790919259.550739:0:14426:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4267b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a397f618-6104-4fd0-addb-afcbd50d641f+7:2353:x1877914532572416:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 892us (1336us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919259.550748:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 14 00000100:00100000:2.0:1790919259.553816:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919259.554005:0:15856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532572672 00000100:00100000:1.0:1790919259.554191:0:15856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532572672 00000100:00100000:1.0:1790919259.554287:0:15856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 53 00000100:00100000:1.0:1790919259.554297:0:15856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beb4265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a397f618-6104-4fd0-addb-afcbd50d641f+14:14458:x1877914532572672:12345-192.168.201.27@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1790919259.554382:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517200/0xc3296956897c58d3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919259.554401:0:15856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517200/0xc3296956897c58d3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919259.554412:0:15856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517200/0xc3296956897c58d3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919259.554730:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517e00/0xc3296956897c58da lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919259.554743:0:15856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c58a2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0ea expref: 15 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919259.554765:0:15856:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517e00/0xc3296956897c58da lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919259.554798:0:15856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c58a2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0ea expref: 15 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919259.554812:0:15856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c58a2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0ea expref: 15 pid: 14439 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919259.554826:0:15856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac3c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15856:1877914550380928:192.168.201.27@tcp:104: 00000100:00100000:1.0:1790919259.554921:0:15856:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be903ffd80 going to sleep for 11 seconds 00000100:00100000:0.0:1790919259.558351:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919259.558835:0:14427:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532572800 00000100:00100000:3.0:1790919259.558845:0:14427:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532572800 00010000:00010000:3.0:1790919259.558884:0:14427:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c58a2 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0ea expref: 16 pid: 14439 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919259.558928:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 15 00000100:00100000:3.0:1790919259.558939:0:14427:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba03d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a397f618-6104-4fd0-addb-afcbd50d641f+16:2352:x1877914532572800:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919259.558954:0:14427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919259.558961:0:14427:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c58a2 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0ea expref: 16 pid: 14439 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919259.558974:0:14427:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c58a2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0ea expref: 16 pid: 14439 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919259.558996:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88be8b621a00) 00010000:00010000:3.0:1790919259.559002:0:14427:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517e00/0xc3296956897c58da lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919259.559012:0:14427:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517e00/0xc3296956897c58da lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919259.559034:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517e00/0xc3296956897c58da lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919259.559232:0:14427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919259.559295:0:14427:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba03d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a397f618-6104-4fd0-addb-afcbd50d641f+16:2352:x1877914532572800:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 357us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919259.559303:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 15 00010000:00010000:1.0:1790919259.559399:0:15856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386200/0xc3296956897c58a2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0ea expref: 15 pid: 14439 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919259.559417:0:15856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac3c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15856:1877914550380928:192.168.201.27@tcp:104: 00010000:00010000:1.0:1790919259.559436:0:15856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517e00/0xc3296956897c58da lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919259.559446:0:15856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517e00/0xc3296956897c58da lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919259.559452:0:15856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517e00/0xc3296956897c58da lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790919259.559666:0:15856:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1790919259.559815:0:15856:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934618 00000001:00080000:1.0:1790919259.559860:0:15856:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1790919259.559959:0:15856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac3c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15856:1877914550381056:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1790919259.561411:0:15856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919259.561453:0:15856:0:(client.c:2716:ptlrpc_set_wait()) set ffff88be903ffd80 going to sleep for 11 seconds 00000100:00100000:0.0:1790919259.561586:0:14444:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550381056 00000100:00100000:0.0:1790919259.561596:0:14444:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550381056 00000100:00100000:0.0:1790919259.561657:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790919259.561668:0:14444:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be85f39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15856:x1877914550381056:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1790919259.561799:0:14444:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be85f39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15856:x1877914550381056:12345-0@lo:1000:mdt00_003.0 Request processed in 134us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919259.561807:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790919259.561970:0:15856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac3c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15856:1877914550381056:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1790919259.562889:0:15856:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934620 00000100:00100000:3.0:1790919259.562982:0:15856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac3c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15856:1877914550381184:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1790919259.563053:0:15856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919259.563991:0:15856:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bd82c4e900 going to sleep for 11 seconds 00000100:00100000:0.0:1790919259.564468:0:14444:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550381184 00000100:00100000:0.0:1790919259.564477:0:14444:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550381184 00000100:00100000:0.0:1790919259.564520:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790919259.564799:0:14444:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15856:x1877914550381184:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1790919259.565202:0:14444:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:15856:x1877914550381184:12345-0@lo:1000:mdt00_003.0 Request processed in 406us (2148us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1790919259.565210:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790919259.565284:0:15856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac3c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15856:1877914550381184:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1790919259.565325:0:15856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517e00/0xc3296956897c58da lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919259.565336:0:15856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517e00/0xc3296956897c58da lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919259.565344:0:15856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517e00/0xc3296956897c58da lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919259.565350:0:15856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81517e00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919259.565355:0:15856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517e00/0xc3296956897c58da lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919259.565363:0:15856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517e00/0xc3296956897c58da lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919259.565397:0:15856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88be8b621a00) 00010000:00010000:3.0:1790919259.565400:0:15856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790919259.565405:0:15856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517e00/0xc3296956897c58da lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919259.565411:0:15856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517e00/0xc3296956897c58da lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919259.565438:0:15856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c5832 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919259.565444:0:15856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c5832 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919259.565449:0:15856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c5832 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919259.565453:0:15856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386600 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919259.565456:0:15856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c5832 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919259.565461:0:15856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c5832 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919259.565467:0:15856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88be8b621400) 00010000:00010000:3.0:1790919259.565469:0:15856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790919259.565476:0:15856:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c5839 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0ce expref: 18 pid: 14440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919259.565486:0:15856:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c5839 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0ce expref: 18 pid: 14440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919259.565502:0:15856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c5839 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0ce expref: 18 pid: 14440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919259.565954:0:15856:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88be88387a00/0xc3296956897c5839 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0xf8b413717672d0ce expref: 18 pid: 14440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919259.565969:0:15856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac5d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15856:1877914550381312:192.168.201.27@tcp:105: 00000100:00100000:3.0:1790919259.566260:0:15856:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bd82c4e900 going to sleep for 11 seconds 00000100:00100000:0.0:1790919259.569888:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919259.569978:0:14442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532572928 00000100:00100000:1.0:1790919259.569989:0:14442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532572928 00000100:00100000:1.0:1790919259.570067:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 10 00000100:00100000:1.0:1790919259.570077:0:14442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebccd5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a397f618-6104-4fd0-addb-afcbd50d641f+19:14457:x1877914532572928:12345-192.168.201.27@tcp:49:dd.0 00000100:00100000:1.0:1790919259.570228:0:14442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebccd5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a397f618-6104-4fd0-addb-afcbd50d641f+19:14457:x1877914532572928:12345-192.168.201.27@tcp:49:dd.0 Request processed in 152us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919259.570235:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 10 00000100:00100000:3.0:1790919259.570570:0:15856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac5d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15856:1877914550381312:192.168.201.27@tcp:105: 00010000:00010000:3.0:1790919259.570596:0:15856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c5832 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919259.570607:0:15856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be88386600/0xc3296956897c5832 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919259.570640:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fa00/0xc3296956897c58e1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919259.570665:0:15856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fa00/0xc3296956897c58e1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919259.570676:0:15856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fa00/0xc3296956897c58e1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919259.570687:0:15856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fa00/0xc3296956897c58e1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919259.570693:0:15856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fa00/0xc3296956897c58e1 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919259.570714:0:15856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fa00/0xc3296956897c58e1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919259.570720:0:15856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be90f9fa00 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919259.570724:0:15856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fa00/0xc3296956897c58e1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919259.570732:0:15856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fa00/0xc3296956897c58e1 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919259.570744:0:15856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88be8b621400) 00010000:00010000:3.0:1790919259.570748:0:15856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919259.570751:0:15856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fa00/0xc3296956897c58e1 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919259.570756:0:15856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be90f9fa00/0xc3296956897c58e1 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919259.570766:0:15856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517200/0xc3296956897c58d3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919259.570772:0:15856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517200/0xc3296956897c58d3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919259.570778:0:15856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517200/0xc3296956897c58d3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919259.570782:0:15856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81517200 already unused, calling callback (ffffffffc21d04f0) 00010000:00010000:3.0:1790919259.570785:0:15856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517200/0xc3296956897c58d3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919259.570802:0:15856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517200/0xc3296956897c58d3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919259.570810:0:15856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88be8b621400) 00010000:00010000:3.0:1790919259.570812:0:15856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790919259.570815:0:15856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517200/0xc3296956897c58d3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919259.570819:0:15856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81517200/0xc3296956897c58d3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919259.571046:0:15856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beb4265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a397f618-6104-4fd0-addb-afcbd50d641f+18:14458:x1877914532572672:12345-192.168.201.27@tcp:57:lhsmtool_posix.0 Request processed in 16749us (17238us total) trans 8589934621 rc 0/0 00000100:00100000:3.0:1790919259.571057:0:15856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 53 00000020:00080000:3.0:1790919259.571061:0:15856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1790919259.571317:0:14472:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1790919259.571322:0:14472:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790919259.571349:0:14472:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1790919259.571354:0:14472:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1790919259.578857:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919259.578976:0:14442:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532573184 00000100:00100000:1.0:1790919259.578988:0:14442:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532573184 00000100:00100000:1.0:1790919259.579067:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 11 00000100:00100000:1.0:1790919259.579079:0:14442:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba03dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a397f618-6104-4fd0-addb-afcbd50d641f+18:14458:x1877914532573184:12345-192.168.201.27@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1790919259.580105:0:14442:0:(mdd_object.c:4180:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1790919259.580215:0:14442:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934622 00010000:00010000:1.0:1790919259.580263:0:14442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c58e8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919259.580280:0:14442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c58e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919259.580291:0:14442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c58e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919259.580313:0:14442:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c58e8 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919259.580320:0:14442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c58e8 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919259.580326:0:14442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c58e8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919259.580463:0:14442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790919259.580664:0:14442:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba03dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a397f618-6104-4fd0-addb-afcbd50d641f+20:14458:x1877914532573184:12345-192.168.201.27@tcp:35:lhsmtool_posix.0 Request processed in 1584us (1814us total) trans 8589934623 rc 0/0 00000100:00100000:1.0:1790919259.580674:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 11 00000020:00080000:1.0:1790919259.580680:0:14442:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790919259.590244:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919259.590260:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c58e8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.590288:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81516600 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:2.0:1790919259.590293:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c58e8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.590303:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c58e8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.590321:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88be8b621a00) 00010000:00010000:2.0:1790919259.590324:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1790919259.590328:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c58e8 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.590334:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88be81516600/0xc3296956897c58e8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919259.590630:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919259.590632:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919259.590634:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919259.772066:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919259.772113:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919259.772145:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1790919259.772249:0:15130:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532573312 00000100:00100000:1.0:1790919259.772260:0:15130:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532573312 00000100:00100000:1.0:1790919259.772313:0:15130:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532573440 00000100:00100000:1.0:1790919259.772317:0:15130:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532573440 00000100:00100000:1.0:1790919259.772329:0:15130:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532573568 00000100:00100000:1.0:1790919259.772332:0:15130:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532573568 00000100:00100000:1.0:1790919259.772352:0:15130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 0 00000100:00100000:1.0:1790919259.772361:0:15130:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba03fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a397f618-6104-4fd0-addb-afcbd50d641f+9:2352:x1877914532573312:12345-192.168.201.27@tcp:4:dd.0 00002000:00010000:1.0:1790919259.772418:0:15130:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6abf425b, atime: 0x6abf425a, ctime: 0x6abf425b, blocks: 0x1 00010000:00010000:1.0:1790919259.772428:0:15130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003439f9ed/0xc3296956897c58ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919259.772466:0:15130:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1790919259.772472:0:15130:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919259.772493:0:15130:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003439f9ed/0xc3296956897c58ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919259.772509:0:15130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003439f9ed/0xc3296956897c58ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919259.905316:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beb4265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:78fab146-b05d-43bc-9885-013f4b87a754:3307:1877914550381440:0@lo:400:kworker.0 00000100:00100000:2.0:1790919259.905393:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919259.905453:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beba14c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1877914550381952:0@lo:400:kworker.0 00000100:00100000:2.0:1790919259.905483:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919259.905512:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790919259.905518:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beba14c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550381568:0@lo:400:kworker.0 00000100:00100000:2.0:1790919259.905562:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919259.905592:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beba14d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877914550381696:0@lo:400:kworker.0 00000100:00100000:2.0:1790919259.905616:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919259.905656:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790919259.905661:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88beba14f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1877914550381824:0@lo:400:kworker.0 00000100:00100000:2.0:1790919259.905685:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919259.905716:0:14433:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550381440 00000100:00100000:2.0:1790919259.905724:0:14433:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550381440 00000100:00100000:2.0:1790919259.905774:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1790919259.905783:0:14433:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba114450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+19:3307:x1877914550381440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919259.905837:0:14433:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba114450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78fab146-b05d-43bc-9885-013f4b87a754+19:3307:x1877914550381440:12345-0@lo:400:kworker.0 Request processed in 55us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919259.905845:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1790919259.905877:0:14441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550381952 00000100:00100000:2.0:1790919259.905880:0:14441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550381952 00000100:00100000:2.0:1790919259.905951:0:14441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550381696 00000100:00100000:2.0:1790919259.905955:0:14441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550381696 00000100:00100000:2.0:1790919259.905987:0:14441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550381824 00000100:00100000:2.0:1790919259.905990:0:14441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550381824 00000100:00100000:2.0:1790919259.906002:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790919259.906009:0:14441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba14ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877914550381952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919259.906170:0:14441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba14ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877914550381952:12345-0@lo:400:kworker.0 Request processed in 161us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919259.906176:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790919259.906190:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790919259.906195:0:14441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba14d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877914550381696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919259.906223:0:14441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba14d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877914550381696:12345-0@lo:400:kworker.0 Request processed in 28us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919259.906229:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790919259.906239:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790919259.906244:0:14441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba14ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877914550381824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919259.906281:0:14441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba14ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877914550381824:12345-0@lo:400:kworker.0 Request processed in 36us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919259.906286:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790919259.906304:0:15125:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550381568 00000100:00100000:2.0:1790919259.906307:0:15125:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550381568 00000100:00100000:2.0:1790919259.906344:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790919259.906350:0:15125:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba14ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550381568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919259.906381:0:15125:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba14ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550381568:12345-0@lo:400:kworker.0 Request processed in 32us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919259.906387:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1790919259.906413:0:14435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790919259.906418:0:14435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790919259.906456:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beba14f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1877914550381824:0@lo:400:kworker.0 00000100:00100000:2.0:1790919259.906465:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beba14d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877914550381696:0@lo:400:kworker.0 00000100:00100000:2.0:1790919259.906489:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beba14c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550381568:0@lo:400:kworker.0 00000100:00100000:2.0:1790919259.906499:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beb4265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:78fab146-b05d-43bc-9885-013f4b87a754:3307:1877914550381440:0@lo:400:kworker.0 00000100:00100000:2.0:1790919259.906507:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88beba14c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1877914550381952:0@lo:400:kworker.0 00000100:00100000:2.0:1790919259.906518:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790919259.906550:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550382080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790919259.906578:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919259.906749:0:15126:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550382080 00000100:00100000:3.0:1790919259.906754:0:15126:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550382080 00000100:00100000:3.0:1790919259.906790:0:15126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790919259.906797:0:15126:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba14c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550382080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790919259.906826:0:15126:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919259.906870:0:15126:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba14c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877914550382080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919259.906876:0:15126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790919259.907035:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1877914550382080:0@lo:13:osp-pre-1-0.0 00002000:00010000:1.0:1790919259.913596:0:15130:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:1.0:1790919259.913606:0:15130:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1790919259 -> 1790919260 00002000:00010000:1.0:1790919259.913609:0:15130:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:1.0:1790919259.913622:0:15130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003439f9ed/0xc3296956897c58ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919259.913634:0:15130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003439f9ed/0xc3296956897c58ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919259.913642:0:15130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003439f9ed/0xc3296956897c58ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919259.913649:0:15130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81516600 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:1.0:1790919259.913654:0:15130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003439f9ed/0xc3296956897c58ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919259.913662:0:15130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003439f9ed/0xc3296956897c58ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919259.913681:0:15130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003439f9ed/0xc3296956897c58ef lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919259.913707:0:15130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003439f9ed/0xc3296956897c58ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919259.913805:0:15130:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba03fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a397f618-6104-4fd0-addb-afcbd50d641f+11:2352:x1877914532573312:12345-192.168.201.27@tcp:4:dd.0 Request processed in 141439us (141745us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1790919259.913814:0:15130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 0 00000100:00100000:1.0:1790919259.913845:0:15130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 1 00000100:00100000:1.0:1790919259.913855:0:15130:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba03c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a397f618-6104-4fd0-addb-afcbd50d641f+10:2352:x1877914532573440:12345-192.168.201.27@tcp:4:dd.0 00002000:00010000:1.0:1790919259.913891:0:15130:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 1048576, mtime: 0x6abf425c, atime: 0x6abf425a, ctime: 0x0, blocks: 0x803 00010000:00010000:1.0:1790919259.913910:0:15130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008ee7f4a/0xc3296956897c58f6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919259.913923:0:15130:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1790919259.913929:0:15130:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919259.913935:0:15130:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008ee7f4a/0xc3296956897c58f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919259.913947:0:15130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008ee7f4a/0xc3296956897c58f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790919259.914067:0:6722:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:1.0:1790919259.914076:0:6722:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00080000:1.0:1790919259.914082:0:6722:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00010000:00010000:3.0:1790919260.032365:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790919260.036038:0:6722:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00002000:00010000:0.0:1790919260.037672:0:15130:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:0.0:1790919260.037688:0:15130:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:0.0:1790919260.037707:0:15130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008ee7f4a/0xc3296956897c58f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919260.037724:0:15130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008ee7f4a/0xc3296956897c58f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919260.037734:0:15130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008ee7f4a/0xc3296956897c58f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919260.037742:0:15130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be81517200 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:0.0:1790919260.037748:0:15130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008ee7f4a/0xc3296956897c58f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919260.037760:0:15130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008ee7f4a/0xc3296956897c58f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919260.037785:0:15130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008ee7f4a/0xc3296956897c58f6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919260.037792:0:15130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008ee7f4a/0xc3296956897c58f6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919260.037990:0:15130:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba03c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a397f618-6104-4fd0-addb-afcbd50d641f+6:2352:x1877914532573440:12345-192.168.201.27@tcp:4:dd.0 Request processed in 124123us (265861us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1790919260.038034:0:15130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 1 00000100:00100000:0.0:1790919260.038089:0:15130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 2 00000100:00100000:0.0:1790919260.038105:0:15130:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba03f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a397f618-6104-4fd0-addb-afcbd50d641f+5:2352:x1877914532573568:12345-192.168.201.27@tcp:4:dd.0 00002000:00010000:0.0:1790919260.038161:0:15130:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 2097152, mtime: 0x6abf425c, atime: 0x6abf425a, ctime: 0x0, blocks: 0x1007 00010000:00010000:0.0:1790919260.038170:0:15130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c58fd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919260.038186:0:15130:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=461s v=(0 0) 00010000:00010000:0.0:1790919260.038191:0:15130:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919260.038200:0:15130:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c58fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919260.038215:0:15130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c58fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790919260.210942:0:6722:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:0.0:1790919260.211131:0:15130:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:0.0:1790919260.211138:0:15130:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:0.0:1790919260.211155:0:15130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c58fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919260.211169:0:15130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c58fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919260.211193:0:15130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c58fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919260.211200:0:15130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac58800 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:0.0:1790919260.211205:0:15130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c58fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919260.211215:0:15130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c58fd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919260.211238:0:15130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c58fd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919260.211245:0:15130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c58fd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919260.211403:0:15130:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba03f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a397f618-6104-4fd0-addb-afcbd50d641f+5:2352:x1877914532573568:12345-192.168.201.27@tcp:4:dd.0 Request processed in 173298us (439251us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1790919260.211415:0:15130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 2 00000100:00100000:1.0:1790919260.221976:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1790919260.222139:0:15128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532573696 00000100:00100000:3.0:1790919260.222150:0:15128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532573696 00000100:00100000:3.0:1790919260.222225:0:15128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 3 00000100:00100000:3.0:1790919260.222235:0:15128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be85f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a397f618-6104-4fd0-addb-afcbd50d641f+5:2350:x1877914532573696:12345-192.168.201.27@tcp:4:dd.0 00002000:00010000:3.0:1790919260.222293:0:15128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6abf425c, atime: 0x6abf425a, ctime: 0x0, blocks: 0x1807 00010000:00010000:3.0:1790919260.222302:0:15128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009cc233e3/0xc3296956897c5904 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919260.222475:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1790919260.222479:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919260.222485:0:15128:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009cc233e3/0xc3296956897c5904 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919260.222499:0:15128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009cc233e3/0xc3296956897c5904 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919260.225988:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919260.228517:0:15130:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1790919260.228583:0:15130:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1790919260.228911:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919260.229025:0:15129:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1790919260.229042:0:15129:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532573824 00000100:00100000:0.0:1790919260.229050:0:15129:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532573824 00000100:00100000:0.0:1790919260.229099:0:15129:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1790919260.229106:0:15129:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532573952 00000100:00100000:0.0:1790919260.229110:0:15129:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532573952 00000100:00100000:2.0:1790919260.230249:0:16678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 4 00000100:00100000:2.0:1790919260.230261:0:16678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be85f38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a397f618-6104-4fd0-addb-afcbd50d641f+8:2351:x1877914532573824:12345-192.168.201.27@tcp:4:dd.0 00010000:00010000:2.0:1790919260.230299:0:16678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000361092be/0xc3296956897c590b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919260.230323:0:16678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919260.230328:0:16678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919260.230336:0:16678:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000361092be/0xc3296956897c590b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919260.230350:0:16678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000361092be/0xc3296956897c590b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919260.240947:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919260.241036:0:15129:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1790919260.241046:0:15129:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:3.0:1790919260.241130:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919260.241318:0:15130:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1790919260.241329:0:15130:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532574080 00000100:00100000:0.0:1790919260.241338:0:15130:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532574080 00000100:00100000:0.0:1790919260.241391:0:15130:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1790919260.241396:0:15130:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532574208 00000100:00100000:0.0:1790919260.241399:0:15130:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532574208 00000100:00100000:3.0:1790919260.242058:0:16679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 5 00000100:00100000:3.0:1790919260.242071:0:16679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a397f618-6104-4fd0-addb-afcbd50d641f+11:2350:x1877914532573952:12345-192.168.201.27@tcp:4:dd.0 00010000:00010000:3.0:1790919260.242108:0:16679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7362843/0xc3296956897c5912 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919260.242126:0:16679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919260.242131:0:16679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919260.242138:0:16679:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7362843/0xc3296956897c5912 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919260.242153:0:16679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7362843/0xc3296956897c5912 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790919260.300624:0:6722:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:2.0:1790919260.310021:0:15128:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 6291456 00002000:00010000:2.0:1790919260.310035:0:15128:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1790919260 -> 1790919261 00002000:00010000:2.0:1790919260.310038:0:15128:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1790919261 00002000:00010000:2.0:1790919260.310040:0:15128:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 12295 00010000:00010000:2.0:1790919260.310055:0:15128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009cc233e3/0xc3296956897c5904 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919260.310069:0:15128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009cc233e3/0xc3296956897c5904 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919260.310078:0:15128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009cc233e3/0xc3296956897c5904 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919260.310086:0:15128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be90f9f400 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:2.0:1790919260.310091:0:15128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009cc233e3/0xc3296956897c5904 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919260.310101:0:15128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009cc233e3/0xc3296956897c5904 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919260.310136:0:15128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009cc233e3/0xc3296956897c5904 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919260.310145:0:15128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009cc233e3/0xc3296956897c5904 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919260.310256:0:15128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be85f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a397f618-6104-4fd0-addb-afcbd50d641f+15:2350:x1877914532573696:12345-192.168.201.27@tcp:4:dd.0 Request processed in 88016us (88289us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1790919260.310268:0:15128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 3 00000100:00100000:2.0:1790919260.310311:0:15128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 6 00000100:00100000:2.0:1790919260.310324:0:15128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a397f618-6104-4fd0-addb-afcbd50d641f+14:2351:x1877914532574080:12345-192.168.201.27@tcp:4:dd.0 00010000:00010000:2.0:1790919260.310359:0:15128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6f6e2c1/0xc3296956897c5919 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919260.310372:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919260.310376:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919260.310382:0:15128:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6f6e2c1/0xc3296956897c5919 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919260.310394:0:15128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6f6e2c1/0xc3296956897c5919 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790919260.374309:0:6722:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00000001:00080000:3.0:1790919260.374335:0:6722:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:0.0:1790919260.374580:0:16678:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00010000:00010000:0.0:1790919260.374597:0:16678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000361092be/0xc3296956897c590b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919260.374611:0:16678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000361092be/0xc3296956897c590b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919260.374619:0:16678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000361092be/0xc3296956897c590b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919260.374626:0:16678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88387800 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:0.0:1790919260.374642:0:16678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000361092be/0xc3296956897c590b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919260.374651:0:16678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000361092be/0xc3296956897c590b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919260.374670:0:16678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000361092be/0xc3296956897c590b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919260.374678:0:16678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000361092be/0xc3296956897c590b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919260.374789:0:16678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be85f38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a397f618-6104-4fd0-addb-afcbd50d641f+12:2351:x1877914532573824:12345-192.168.201.27@tcp:4:dd.0 Request processed in 144525us (148806us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1790919260.374799:0:16678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 4 00000100:00100000:0.0:1790919260.374830:0:16678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 7 00000100:00100000:0.0:1790919260.374841:0:16678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88bebac91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a397f618-6104-4fd0-addb-afcbd50d641f+11:2351:x1877914532574208:12345-192.168.201.27@tcp:4:dd.0 00010000:00010000:0.0:1790919260.374870:0:16678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c5920 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919260.374882:0:16678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919260.374896:0:16678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919260.374904:0:16678:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c5920 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919260.374916:0:16678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c5920 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919260.376626:0:16679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7362843/0xc3296956897c5912 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919260.376671:0:16679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7362843/0xc3296956897c5912 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919260.376680:0:16679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7362843/0xc3296956897c5912 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919260.376687:0:16679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be90f9fa00 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:2.0:1790919260.376691:0:16679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7362843/0xc3296956897c5912 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919260.376700:0:16679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7362843/0xc3296956897c5912 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919260.376718:0:16679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7362843/0xc3296956897c5912 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919260.376725:0:16679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7362843/0xc3296956897c5912 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919260.376790:0:16679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a397f618-6104-4fd0-addb-afcbd50d641f+11:2350:x1877914532573952:12345-192.168.201.27@tcp:4:dd.0 Request processed in 134718us (147881us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1790919260.376799:0:16679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 5 00000001:00080000:3.0:1790919260.451763:0:6722:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:3.0:1790919260.452031:0:15128:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:3.0:1790919260.452035:0:15128:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:3.0:1790919260.452049:0:15128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6f6e2c1/0xc3296956897c5919 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919260.452062:0:15128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6f6e2c1/0xc3296956897c5919 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919260.452071:0:15128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6f6e2c1/0xc3296956897c5919 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919260.452078:0:15128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88be88386c00 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:3.0:1790919260.452082:0:15128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6f6e2c1/0xc3296956897c5919 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919260.452091:0:15128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6f6e2c1/0xc3296956897c5919 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919260.452112:0:15128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6f6e2c1/0xc3296956897c5919 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919260.452119:0:15128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6f6e2c1/0xc3296956897c5919 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919260.452234:0:15128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a397f618-6104-4fd0-addb-afcbd50d641f+9:2351:x1877914532574080:12345-192.168.201.27@tcp:4:dd.0 Request processed in 141910us (211294us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1790919260.452245:0:15128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 6 00000001:00080000:1.0:1790919260.528355:0:6722:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00002000:00010000:2.0:1790919260.529050:0:16678:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:2.0:1790919260.529067:0:16678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c5920 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919260.529097:0:16678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c5920 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919260.529108:0:16678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c5920 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919260.529115:0:16678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88bebac58800 already unused, calling callback (ffffffffc175bac0) 00010000:00010000:2.0:1790919260.529120:0:16678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c5920 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919260.529129:0:16678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c5920 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919260.529150:0:16678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c5920 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919260.529158:0:16678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006405d0e8/0xc3296956897c5920 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919260.529268:0:16678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88bebac91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a397f618-6104-4fd0-addb-afcbd50d641f+5:2351:x1877914532574208:12345-192.168.201.27@tcp:4:dd.0 Request processed in 154426us (288132us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1790919260.529279:0:16678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 7 00010000:00010000:2.0:1790919261.056992:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919262.079896:0:14428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790919262.342916:0:16716:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:1.0:1790919262.465517:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790919262.465569:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bebac92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550382208:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790919262.465661:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919262.465821:0:15126:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914550382208 00000100:00100000:3.0:1790919262.465830:0:15126:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914550382208 00000100:00100000:3.0:1790919262.465902:0:15126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790919262.465913:0:15126:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88be85f3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550382208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790919262.465950:0:15126:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 6815744 granted 62980096 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1790919262.466002:0:15126:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88be85f3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877914550382208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919262.466009:0:15126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790919262.466053:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1790919262.466059:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88beb3b39500, transno 8589934595 00000004:00080000:3.0:1790919262.466069:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1790919262.466098:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bebac92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1877914550382208:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790919262.467782:0:14435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790919262.928231:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919262.928296:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919262.928336:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919262.928377:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919262.928403:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919262.928420:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919262.928441:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1790919262.928468:0:14432:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532574336 00000100:00100000:0.0:1790919262.928477:0:14432:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532574336 00000100:00100000:0.0:1790919262.928599:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 122 00000100:00100000:0.0:1790919262.928610:0:14432:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba117c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f601f44-7343-45ca-9d5e-f7bb6777e55d+13:2352:x1877914532574336:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:0.0:1790919262.928674:0:14432:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba117c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f601f44-7343-45ca-9d5e-f7bb6777e55d+13:2352:x1877914532574336:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 67us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919262.928915:0:14441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532574464 00000100:00100000:2.0:1790919262.928921:0:14441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532574464 00000100:00100000:2.0:1790919262.928962:0:14441:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532574848 00000100:00100000:2.0:1790919262.928973:0:14441:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532574848 00000100:00100000:2.0:1790919262.928999:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 29 00000100:00100000:2.0:1790919262.929007:0:14441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba03d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a397f618-6104-4fd0-addb-afcbd50d641f+20:2352:x1877914532574464:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:2.0:1790919262.929059:0:14441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba03d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a397f618-6104-4fd0-addb-afcbd50d641f+20:2352:x1877914532574464:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 52us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919262.929066:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 29 00000100:00100000:2.0:1790919262.929084:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 30 00000100:00100000:2.0:1790919262.929090:0:14441:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba03d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:971222de-c593-4f1b-9c93-71dc3d112472+6:2352:x1877914532574848:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:2.0:1790919262.929118:0:14441:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba03d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:971222de-c593-4f1b-9c93-71dc3d112472+6:2352:x1877914532574848:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 29us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919262.929124:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 30 00000100:00100000:2.0:1790919262.929140:0:15125:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532574720 00000100:00100000:2.0:1790919262.929142:0:15125:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532574720 00000100:00100000:2.0:1790919262.929158:0:15125:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532574976 00000100:00100000:2.0:1790919262.929160:0:15125:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532574976 00000100:00100000:2.0:1790919262.929171:0:15125:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532574592 00000100:00100000:2.0:1790919262.929173:0:15125:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532574592 00000100:00100000:2.0:1790919262.929182:0:15125:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914532575104 00000100:00100000:2.0:1790919262.929184:0:15125:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914532575104 00000100:00100000:2.0:1790919262.929196:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 17 00000100:00100000:2.0:1790919262.929201:0:15125:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba03e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a397f618-6104-4fd0-addb-afcbd50d641f+5:2352:x1877914532574720:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:2.0:1790919262.929226:0:15125:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba03e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a397f618-6104-4fd0-addb-afcbd50d641f+5:2352:x1877914532574720:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 25us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919262.929232:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 17 00000100:00100000:2.0:1790919262.929242:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 18 00000100:00100000:2.0:1790919262.929247:0:15125:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba03c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:971222de-c593-4f1b-9c93-71dc3d112472+5:2352:x1877914532574976:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:2.0:1790919262.929279:0:15125:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba03c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:971222de-c593-4f1b-9c93-71dc3d112472+5:2352:x1877914532574976:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 32us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919262.929286:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 18 00000100:00100000:2.0:1790919262.929298:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 19 00000100:00100000:2.0:1790919262.929304:0:15125:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba03ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a397f618-6104-4fd0-addb-afcbd50d641f+5:2352:x1877914532574592:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:2.0:1790919262.929345:0:15125:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba03ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a397f618-6104-4fd0-addb-afcbd50d641f+5:2352:x1877914532574592:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 41us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919262.929351:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 19 00000100:00100000:2.0:1790919262.929362:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 20 00000100:00100000:2.0:1790919262.929368:0:15125:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff88beba03ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:971222de-c593-4f1b-9c93-71dc3d112472+5:2352:x1877914532575104:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:2.0:1790919262.929389:0:15125:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff88beba03ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:971222de-c593-4f1b-9c93-71dc3d112472+5:2352:x1877914532575104:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 22us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919262.929394:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 20 00000100:00080000:2.0:1790919262.929416:0:14435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790919262.929420:0:14435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790919262.929423:0:14435:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790919262.929644:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 122 00010000:00010000:2.0:1790919263.104778:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790919263.682819:0:14472:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1790919263.682840:0:14472:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790919263.682877:0:14472:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1790919263.682888:0:14472:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 Debug log: 29599 lines, 29599 kept, 0 dropped, 0 bad.